Nov 01 08:44:55 devstack cinder-volume[75731]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 08:44:55 devstack cinder-volume[75731]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 08:44:55 devstack cinder-volume[75731]: we strongly recommend against using it for new projects. Nov 01 08:44:55 devstack cinder-volume[75731]: If you are already using Eventlet, we recommend migrating to a different Nov 01 08:44:55 devstack cinder-volume[75731]: framework. For more detail see Nov 01 08:44:55 devstack cinder-volume[75731]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 08:44:55 devstack cinder-volume[75731]: import eventlet # noqa Nov 01 08:44:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 08:44:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 08:44:57 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 08:44:58 devstack cinder-volume[75731]: INFO dbcounter [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Registered counter for database cinder Nov 01 08:44:58 devstack cinder-volume[75731]: DEBUG oslo_db.sqlalchemy.engines [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writer thread running {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 08:44:59 devstack cinder-volume[75731]: INFO cinder.rpc [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 08:44:59 devstack cinder-volume[75731]: INFO cinder.rpc [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG oslo_db.sqlalchemy.engines [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:44:59 devstack cinder-volume[75731]: INFO cinder.volume.manager [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Determined volume DB was empty at startup. Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG cinder.volume.manager [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75731) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 08:44:59 devstack cinder-volume[75731]: INFO cinder.volume.manager [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 08:44:59 devstack cinder-volume[75731]: WARNING stevedore.named [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 08:44:59 devstack cinder-volume[75731]: WARNING castellan.key_manager [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 08:44:59 devstack cinder-volume[75731]: WARNING cinder.keymgr.conf_key_mgr [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG cinder.volume.drivers.lvm [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75731) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG oslo_concurrency.processutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] CMD "cinder-rtstool verify" returned: 0 in 0.421s {{(pid=75731) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG oslo_db.sqlalchemy.engines [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:44:59 devstack cinder-volume[75731]: INFO cinder.rpc [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 01 08:44:59 devstack cinder-volume[75731]: INFO cinder.rpc [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 01 08:44:59 devstack cinder-volume[75731]: WARNING stevedore.named [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 08:44:59 devstack cinder-volume[75731]: WARNING castellan.key_manager [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 08:44:59 devstack cinder-volume[75731]: INFO cinder.volume.manager [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 01 08:44:59 devstack cinder-volume[75731]: DEBUG oslo_db.sqlalchemy.engines [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:45:00 devstack cinder-volume[75731]: INFO oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Starting 1 workers Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Started child 75880 {{(pid=75731) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Full set of CONF: {{(pid=75731) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] ******************************************************************************** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Configuration options gathered from: {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] ================================================================================ {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] allow_availability_zone_fallback = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] allow_compression_on_image_upload = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] allowed_direct_url_schemes = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] api_rate_limit = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] auth_strategy = keystone {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] az_cache_duration = 3600 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_availability_zone = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_host = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_stats_polling_interval = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backup_api_class = cinder.backup.api.API {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backup_name_template = backup-%s {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backup_use_same_host = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backup_use_temp_snapshot = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] chap_password = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] chap_username = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_internal_tenant_project_id = 1f8ab8c55aae4d7f994e8688683c330f {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75880]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_internal_tenant_user_id = 93b97c85d5bb4bc58615e154fec4b5a0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cloned_volume_same_az = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cluster = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] compression_format = gzip {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] compute_api_class = cinder.compute.nova.API {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] config_dir = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] config_source = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] control_exchange = openstack {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] debug = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] default_availability_zone = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] default_group_type = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] default_volume_type = lvmdriver-1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] disk_geometry = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] driver_client_cert = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] driver_client_cert_key = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] driver_data_namespace = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] driver_ssl_cert_path = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] driver_ssl_cert_verify = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] driver_use_ssl = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] enable_force_upload = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] enable_new_services = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] enable_unsupported_driver = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] enforce_multipath_for_image_xfer = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] filter_function = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_api_insecure = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_api_servers = ['http://192.168.122.188/image'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_api_ssl_compression = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_ca_certificates_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_catalog_info = image:glance:publicURL {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_num_retries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance_request_timeout = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] goodness_function = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] graceful_shutdown_timeout = 5 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] group_api_class = cinder.group.api.API {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] host = devstack {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_compress_on_upload = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_conversion_address_space_limit = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_conversion_cpu_limit = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_conversion_disable = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_introspection_address_space_limit = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_introspection_cpu_limit = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_upload_use_cinder_backend = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_upload_use_internal_tenant = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_volume_cache_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_volume_cache_max_count = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] image_volume_cache_max_size_gb = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] init_host_max_objects_retrieval = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] instance_format = [instance: %(uuid)s] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] iscsi_target_flags = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] iscsi_write_cache = on {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] iser_helper = tgtadm {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] iser_ip_address = 192.168.122.188 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] iser_port = 3260 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_color = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_config_append = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_dir = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_options = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_rotate_interval = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_rotate_interval_type = days {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] log_rotation_type = none {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] max_age = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] max_logfile_count = 30 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] max_logfile_size_mb = 200 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] max_over_subscription_ratio = 20.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] message_reap_interval = 86400 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] message_ttl = 2592000 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] migration_create_volume_timeout_secs = 300 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] monkey_patch = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] monkey_patch_modules = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] my_ip = 192.168.122.188 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] no_snapshot_gb_quota = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] num_iser_scan_tries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] num_shell_tries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] num_volume_device_scan_tries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] nvmeof_conn_info_version = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] nvmet_ns_id = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] nvmet_port_id = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] osapi_max_limit = 1000 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] osapi_volume_ext_list = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] osapi_volume_listen_port = 8776 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] osapi_volume_use_ssl = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] osapi_volume_workers = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] per_volume_size_limit = -1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] periodic_fuzzy_delay = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] periodic_interval = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] public_endpoint = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] publish_errors = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] quota_backup_gigabytes = 1000 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] quota_backups = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] quota_gigabytes = 1000 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] quota_groups = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] quota_snapshots = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] quota_volumes = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] rate_limit_burst = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] rate_limit_except_level = CRITICAL {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] rate_limit_interval = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] reinit_driver_count = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] replication_device = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] report_discard_supported = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] report_interval = 120 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] reservation_clean_interval = 86400 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] reservation_expire = 86400 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] reserved_image_namespaces = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] reserved_percentage = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] rpc_response_timeout = 120 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] run_external_periodic_tasks = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] scst_target_driver = iscsi {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] scst_target_iqn_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_down_time = 720 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] shell_completion = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] snapshot_name_template = snapshot-%s {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] snapshot_same_host = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] split_loggers = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] state_path = /opt/stack/data/cinder {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] storage_availability_zone = nova {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] storage_protocol = iSCSI {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] syslog_log_facility = LOG_USER {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] target_helper = lioadm {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] target_ip_address = 192.168.122.188 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] target_port = 3260 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] target_protocol = iscsi {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] target_secondary_ip_addresses = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] trace_flags = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] transport_url = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] until_refresh = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] use_chap_auth = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] use_default_quota_class = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] use_journal = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] use_json = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] use_multipath_for_image_xfer = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] use_stderr = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] use_syslog = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] verify_glance_signatures = enabled {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_api_class = cinder.volume.api.API {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_backend_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_clear = zero {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_clear_ionice = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_clear_size = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_copy_bps_limit = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_dd_blocksize = 1M {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_name_template = volume-%s {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_service_inithost_offload = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volume_usage_audit_period = month {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] zoning_mode = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_concurrency.disable_process_locking = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.auth_section = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.auth_type = password {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.auth_version = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.cache = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.include_service_catalog = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.insecure = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.interface = public {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_password = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcache_username = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.region_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.service_type = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.188/identity {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.backend = dogpile.cache.null {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.backend_argument = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.backend_expiration_time = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.config_prefix = cache.oslo {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.debug_cache_backend = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.enable_retry_client = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.enable_socket_keepalive = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.expiration_time = 600 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.hashclient_retry_attempts = 2 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.memcache_dead_retry = 300 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.memcache_pool_maxsize = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.memcache_sasl_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.password = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.proxies = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.redis_db = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.redis_server = localhost:6379 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.retry_attempts = 2 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.retry_delay = 0.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.socket_keepalive_count = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.socket_keepalive_idle = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.socket_keepalive_interval = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.socket_timeout = 1.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.tls_allowed_ciphers = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.tls_cafile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.tls_certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.tls_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.tls_keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cache.username = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] coordination.backend_url = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.asyncio_connection = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.asyncio_slave_connection = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.backend = sqlalchemy {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.connection = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.connection_debug = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.connection_parameters = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.connection_recycle_time = 3600 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.connection_trace = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.db_inc_retry_interval = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.db_max_retries = 20 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.db_max_retry_interval = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.db_retry_interval = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.max_overflow = 50 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.max_pool_size = 5 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.max_retries = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.mysql_wsrep_sync_wait = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.pool_timeout = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.retry_interval = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.slave_connection = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.sqlite_synchronous = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.synchronous_reader = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] database.use_db_reconnect = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_tracing.insecure = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.connection_string = messaging:// {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.es_doc_type = notification {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.es_scroll_size = 10000 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.es_scroll_time = 2m {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.filter_error_trace = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.hmac_keys = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.sentinel_service_name = mymaster {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.socket_timeout = 0.1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.trace_requests = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler.trace_sqlalchemy = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler_jaeger.process_tags = {} {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler_jaeger.service_name_prefix = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] profiler_otlp.service_name_prefix = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.enforce_new_defaults = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.policy_default_rule = default {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.policy_file = policy.yaml {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] privsep_osbrick.group = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] privsep_osbrick.helper_command = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] privsep_osbrick.user = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_sys_admin.group = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_sys_admin.helper_command = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] cinder_sys_admin.user = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.auth_section = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.auth_type = password {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.cafile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.collect_timing = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.insecure = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.send_service_user_token = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.split_loggers = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack sudo[75888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.timeout = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.tls_ciphers = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] service_user.tls_min_version = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.auth_section = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack sudo[75888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.auth_type = password {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.collect_timing = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.insecure = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.region_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.split_loggers = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.timeout = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.tls_ciphers = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] glance.tls_min_version = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.backend_availability_zone = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.chap_password = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.chap_username = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.disk_geometry = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.driver_client_cert = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.driver_client_cert_key = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.driver_data_namespace = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.driver_use_ssl = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.extra_capabilities = {} {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.filter_function = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.goodness_function = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.iscsi_target_flags = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.iscsi_write_cache = on {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.iser_helper = tgtadm {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.iser_ip_address = 192.168.122.188 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.iser_port = 3260 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.lvm_share_target = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.lvm_type = auto {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.num_shell_tries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.replication_device = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.report_discard_supported = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.reserved_percentage = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.target_helper = tgtadm {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.target_ip_address = 192.168.122.188 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.target_port = 3260 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.target_protocol = iscsi {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.trace_flags = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.unique_fqdn_network = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.use_chap_auth = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_backend_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_clear = zero {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_clear_ionice = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_clear_size = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_reports.file_event_handler = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_reports.log_dir = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.backend_host = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.chap_password = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.chap_username = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.disk_geometry = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.driver_client_cert = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.extra_capabilities = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.filter_function = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.goodness_function = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.iser_helper = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.iser_ip_address = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.iser_port = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.lvm_share_target = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.lvm_type = auto {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.num_shell_tries = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.replication_device = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.report_discard_supported = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.reserved_percentage = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.scst_target_driver = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.storage_protocol = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.target_helper = lioadm {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.target_ip_address = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.target_port = 3260 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.trace_flags = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.use_chap_auth = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_clear = zero {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_clear_size = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] lvmdriver-1.volumes_dir = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.ssl = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_notifications.driver = [] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_notifications.retry = -1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] key_manager.fixed_key = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.barbican_api_version = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.barbican_endpoint = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.barbican_endpoint_type = public {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.barbican_region_name = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.cafile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.collect_timing = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.insecure = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.number_of_retries = 60 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.retry_delay = 1 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.send_service_user_token = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.split_loggers = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.timeout = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.tls_ciphers = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.tls_min_version = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.verify_ssl = True {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican.verify_ssl_path = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.auth_section = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.auth_type = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.cafile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.certfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.collect_timing = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.insecure = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.keyfile = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.split_loggers = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.timeout = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.tls_ciphers = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] barbican_service_user.tls_min_version = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.approle_role_id = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.approle_secret_id = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.auth_method = approle {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.auth_path = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.kv_mountpoint = secret {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.kv_path = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.kv_version = 2 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.namespace = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.root_token_id = **** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.ssl_ca_crt_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.timeout = 60.0 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.token_file = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.token_role = None {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.use_ssl = False {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:45:00 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] ******************************************************************************** {{(pid=75731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 08:45:00 devstack sudo[75888]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:00 devstack sudo[75957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:00 devstack sudo[75957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:00 devstack sudo[75957]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 08:45:00 devstack cinder-volume[75880]: INFO cinder.brick.local_dev.lvm [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:00 devstack sudo[76082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:45:00 devstack sudo[76082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:01 devstack sudo[76082]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG cinder.brick.local_dev.lvm [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75880) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:01 devstack sudo[76172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:01 devstack sudo[76172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:01 devstack sudo[76172]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:01 devstack sudo[76369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:01 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:01 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:02 devstack sudo[76482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 01 08:45:02 devstack sudo[76482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:02 devstack sudo[76482]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:02 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.284s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:02 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:02 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:45:02 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:02 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:02 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:02 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:02 devstack sudo[76553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:45:02 devstack sudo[76553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:02 devstack sudo[76553]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:02 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:02 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:02 devstack sudo[76586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:45:02 devstack sudo[76586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:03 devstack sudo[76586]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:03 devstack sudo[76598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:03 devstack sudo[76598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:03 devstack sudo[76598]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.360s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:03 devstack sudo[76685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:03 devstack sudo[76685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:03 devstack sudo[76685]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:03 devstack cinder-volume[75880]: INFO cinder.volume.drivers.lvm [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:03 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:03 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:03 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:04 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:04 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:45:04 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:04 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:04 devstack sudo[76701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:45:04 devstack sudo[76701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:04 devstack sudo[76701]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:04 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:04 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:04 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:04 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:04 devstack sudo[76707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:45:04 devstack sudo[76707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:05 devstack sudo[76707]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:05 devstack cinder-volume[75880]: INFO cinder.volume.driver [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Driver hasn't implemented _init_vendor_properties() Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG cinder.volume.driver [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75880) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG oslo_db.sqlalchemy.engines [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writer thread running {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG cinder.db.api [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Building query based on filter {{(pid=75880) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG cinder.image.image_utils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75880) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 08:45:05 devstack cinder-volume[75880]: INFO cinder.keymgr.migration [None req-60e1cd4a-eaf2-470e-9e63-62f9b8d40d02 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:05 devstack sudo[76710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:45:05 devstack sudo[76710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:05 devstack sudo[76710]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.354s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:05 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:45:05 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:05 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:05 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:06 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:06 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:06 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:06 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:45:06 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:06 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:45:06 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Driver initialization completed successfully. Nov 01 08:45:06 devstack cinder-volume[75880]: INFO cinder.manager [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Initiating service 2 cleanup Nov 01 08:45:06 devstack cinder-volume[75880]: INFO cinder.manager [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Service 2 cleanup completed. Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG cinder.service [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Creating RPC server for service cinder-volume {{(pid=75880) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG cinder.service [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75880) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 08:45:06 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:06 devstack sudo[76727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:45:06 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:06 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:06 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:07 devstack sudo[76731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:45:07 devstack sudo[76731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:07 devstack sudo[76731]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:07 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:07 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:07 devstack sudo[76737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:45:07 devstack sudo[76737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:07 devstack sudo[76737]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:07 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:07 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:45:07 devstack sudo[76740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:45:07 devstack sudo[76740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:45:07 devstack sudo[76740]: pam_unix(sudo:session): session closed for user root Nov 01 08:45:07 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:45:07 devstack cinder-volume[75880]: INFO cinder.volume.manager [None req-b1843415-b9ef-4bcc-ac9f-660c489e8dfe None None] Driver post RPC initialization completed successfully. Nov 01 08:45:10 devstack cinder-volume[75731]: DEBUG dbcounter [-] [75731] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:45:17 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=2 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:45:17 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:46:00 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:46:00 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 08:46:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:46:00 devstack sudo[78627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:46:00 devstack sudo[78627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:46:01 devstack sudo[78627]: pam_unix(sudo:session): session closed for user root Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:46:01 devstack sudo[78630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:46:01 devstack sudo[78630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:46:01 devstack sudo[78630]: pam_unix(sudo:session): session closed for user root Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:46:01 devstack sudo[78633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:46:01 devstack sudo[78633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:46:01 devstack sudo[78633]: pam_unix(sudo:session): session closed for user root Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:46:01 devstack sudo[78639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:46:01 devstack sudo[78639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:46:01 devstack sudo[78639]: pam_unix(sudo:session): session closed for user root Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running periodic task VolumeManager._thread_info {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG cinder.volume.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] thread count: 6 {{(pid=75880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:46:01 devstack cinder-volume[75880]: DEBUG cinder.volume.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] thread info: [<_MainThread(MainThread, started 140532690993280)>, , , , , ] {{(pid=75880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:47:00 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:47:00 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 08:47:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:47:00 devstack sudo[81945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:47:00 devstack sudo[81945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:47:01 devstack sudo[81945]: pam_unix(sudo:session): session closed for user root Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:47:01 devstack sudo[81949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:47:01 devstack sudo[81949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:47:01 devstack sudo[81949]: pam_unix(sudo:session): session closed for user root Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:47:01 devstack sudo[81956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:47:01 devstack sudo[81956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:47:01 devstack sudo[81956]: pam_unix(sudo:session): session closed for user root Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:47:01 devstack sudo[81962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:47:01 devstack sudo[81962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:47:01 devstack sudo[81962]: pam_unix(sudo:session): session closed for user root Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running periodic task VolumeManager._thread_info {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG cinder.volume.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] thread count: 6 {{(pid=75880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:47:01 devstack cinder-volume[75880]: DEBUG cinder.volume.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] thread info: [<_MainThread(MainThread, started 140532690993280)>, , , , , ] {{(pid=75880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:47:17 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:48:00 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:48:00 devstack cinder-volume[75880]: DEBUG cinder.volume.drivers.lvm [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Updating volume stats {{(pid=75880) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 08:48:00 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:48:00 devstack sudo[84051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 08:48:00 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:48:01 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:48:01 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:48:01 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:48:01 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:48:01 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 08:48:01 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:48:01 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:48:01 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 08:48:01 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:48:01 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_concurrency.processutils [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75880) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG cinder.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Notifying Schedulers of capabilities ... {{(pid=75880) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG oslo_service.periodic_task [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] Running periodic task VolumeManager._thread_info {{(pid=75880) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG cinder.volume.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] thread count: 6 {{(pid=75880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:48:01 devstack cinder-volume[75880]: DEBUG cinder.volume.manager [None req-92ee9466-e0bd-4508-9f38-4978399f8085 None None] thread info: [<_MainThread(MainThread, started 140532690993280)>, , , , , ] {{(pid=75880) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:49:17 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:SELECT=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:49:17 devstack cinder-volume[75880]: DEBUG dbcounter [-] [75880] Writing DB stats cinder:UPDATE=1 {{(pid=75880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:49:26 devstack cinder-volume[75731]: INFO oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Caught SIGTERM, stopping children Nov 01 08:49:26 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Acquiring lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 08:49:26 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Acquired lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 08:49:26 devstack cinder-volume[75731]: DEBUG oslo_concurrency.lockutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Releasing lock "singleton_lock" {{(pid=75731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 08:49:26 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Stop services. {{(pid=75731) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 08:49:26 devstack cinder-volume[75731]: DEBUG oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Killing children. {{(pid=75731) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 08:49:26 devstack cinder-volume[75731]: INFO oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Waiting on 1 children to exit Nov 01 08:49:26 devstack cinder-volume[75880]: DEBUG oslo_concurrency.lockutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Acquiring lock "singleton_lock" {{(pid=75880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 08:49:26 devstack cinder-volume[75880]: DEBUG oslo_concurrency.lockutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Acquired lock "singleton_lock" {{(pid=75880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 08:49:26 devstack cinder-volume[75880]: DEBUG oslo_concurrency.lockutils [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Releasing lock "singleton_lock" {{(pid=75880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 08:49:26 devstack cinder-volume[75880]: WARNING amqp [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 08:49:26 devstack cinder-volume[75880]: WARNING amqp [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 08:49:26 devstack cinder-volume[75731]: INFO oslo_service.backend._eventlet.service [None req-86a021d0-e835-4189-abef-8cdfa35d2c1f None None] Child 75880 exited with status 0 Nov 01 08:49:27 devstack cinder-volume[85893]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 08:49:27 devstack cinder-volume[85893]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 08:49:27 devstack cinder-volume[85893]: we strongly recommend against using it for new projects. Nov 01 08:49:27 devstack cinder-volume[85893]: If you are already using Eventlet, we recommend migrating to a different Nov 01 08:49:27 devstack cinder-volume[85893]: framework. For more detail see Nov 01 08:49:27 devstack cinder-volume[85893]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 08:49:27 devstack cinder-volume[85893]: import eventlet # noqa Nov 01 08:49:29 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 08:49:29 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 08:49:29 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 08:49:29 devstack cinder-volume[85893]: INFO dbcounter [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Registered counter for database cinder Nov 01 08:49:29 devstack cinder-volume[85893]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG dbcounter [-] [85893] Writer thread running {{(pid=85893) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 08:49:30 devstack cinder-volume[85893]: INFO cinder.rpc [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 08:49:30 devstack cinder-volume[85893]: INFO cinder.rpc [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:30 devstack cinder-volume[85893]: INFO cinder.volume.manager [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Determined volume DB was empty at startup. Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG cinder.volume.manager [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85893) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 08:49:30 devstack cinder-volume[85893]: INFO cinder.volume.manager [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 08:49:30 devstack cinder-volume[85893]: WARNING stevedore.named [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 08:49:30 devstack cinder-volume[85893]: WARNING castellan.key_manager [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 08:49:30 devstack cinder-volume[85893]: WARNING cinder.keymgr.conf_key_mgr [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 08:49:30 devstack cinder-volume[85893]: INFO cinder.volume.manager [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:30 devstack cinder-volume[85893]: INFO oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Starting 1 workers Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Started child 86110 {{(pid=85893) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Full set of CONF: {{(pid=85893) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] ******************************************************************************** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Configuration options gathered from: {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] ================================================================================ {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] allow_availability_zone_fallback = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] allow_compression_on_image_upload = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] allowed_direct_url_schemes = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[86110]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] api_rate_limit = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] auth_strategy = keystone {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_availability_zone = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_host = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_stats_polling_interval = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backup_api_class = cinder.backup.api.API {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backup_name_template = backup-%s {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backup_use_same_host = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backup_use_temp_snapshot = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] chap_password = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] chap_username = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_internal_tenant_project_id = 1f8ab8c55aae4d7f994e8688683c330f {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_internal_tenant_user_id = 93b97c85d5bb4bc58615e154fec4b5a0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cluster = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] compression_format = gzip {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] compute_api_class = cinder.compute.nova.API {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] config_dir = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] config_source = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] control_exchange = openstack {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] debug = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] default_availability_zone = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] default_group_type = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] default_volume_type = QuobyteHD {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] disk_geometry = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] driver_client_cert = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] driver_client_cert_key = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] driver_data_namespace = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] driver_ssl_cert_path = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] driver_ssl_cert_verify = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] driver_use_ssl = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] enable_new_services = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] enable_unsupported_driver = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] enabled_backends = ['QuobyteHD'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] enforce_multipath_for_image_xfer = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] filter_function = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_api_insecure = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_api_servers = ['http://192.168.122.188/image'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_api_ssl_compression = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_ca_certificates_file = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_catalog_info = image:glance:publicURL {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_num_retries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance_request_timeout = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] goodness_function = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] graceful_shutdown_timeout = 5 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] group_api_class = cinder.group.api.API {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] host = devstack {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_compress_on_upload = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_conversion_address_space_limit = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_conversion_cpu_limit = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_conversion_disable = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_introspection_address_space_limit = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_introspection_cpu_limit = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_upload_use_cinder_backend = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_upload_use_internal_tenant = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_volume_cache_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_volume_cache_max_count = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] image_volume_cache_max_size_gb = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] init_host_max_objects_retrieval = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] instance_format = [instance: %(uuid)s] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] iscsi_target_flags = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] iscsi_write_cache = on {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] iser_helper = tgtadm {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] iser_ip_address = 192.168.122.188 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] iser_port = 3260 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_color = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_config_append = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_dir = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_file = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_options = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_rotate_interval = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_rotate_interval_type = days {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] log_rotation_type = none {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[86110]: INFO cinder.volume.manager [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] max_age = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] max_logfile_count = 30 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] max_logfile_size_mb = 200 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] max_over_subscription_ratio = 20.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.remotefs [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86110) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] message_reap_interval = 86400 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] message_ttl = 2592000 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] migration_create_volume_timeout_secs = 300 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] monkey_patch = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] monkey_patch_modules = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] my_ip = 192.168.122.188 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] no_snapshot_gb_quota = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] num_iser_scan_tries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] num_shell_tries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] num_volume_device_scan_tries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] nvmeof_conn_info_version = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] nvmet_ns_id = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] nvmet_port_id = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] osapi_max_limit = 1000 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] osapi_volume_ext_list = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] osapi_volume_listen = 0.0.0.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] osapi_volume_listen_port = 8776 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] osapi_volume_use_ssl = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] osapi_volume_workers = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] per_volume_size_limit = -1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] periodic_fuzzy_delay = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] periodic_interval = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] project_id_regex = [0-9a-f\-]+ {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] public_endpoint = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] publish_errors = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] quota_backup_gigabytes = 1000 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] quota_backups = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] quota_gigabytes = 1000 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] quota_groups = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] quota_snapshots = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] quota_volumes = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] rate_limit_burst = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] rate_limit_except_level = CRITICAL {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] rate_limit_interval = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] reinit_driver_count = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] replication_device = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] report_discard_supported = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] report_interval = 120 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] reservation_clean_interval = 86400 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] reservation_expire = 86400 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] reserved_image_namespaces = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] reserved_percentage = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] rpc_response_timeout = 120 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] run_external_periodic_tasks = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] scst_target_driver = iscsi {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] scst_target_iqn_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_down_time = 720 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] shell_completion = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] snapshot_name_template = snapshot-%s {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] split_loggers = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] state_path = /opt/stack/data/cinder {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] storage_availability_zone = nova {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] storage_protocol = iSCSI {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] syslog_log_facility = LOG_USER {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] target_helper = lioadm {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] target_ip_address = 192.168.122.188 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] target_port = 3260 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] target_protocol = iscsi {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] target_secondary_ip_addresses = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] trace_flags = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] transfer_api_class = cinder.transfer.api.API {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] transport_url = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] until_refresh = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] use_chap_auth = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] use_default_quota_class = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] use_journal = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] use_json = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] use_multipath_for_image_xfer = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] use_stderr = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] use_syslog = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] verify_glance_signatures = enabled {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_api_class = cinder.volume.api.API {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_backend_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_clear = zero {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_clear_ionice = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_clear_size = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_copy_bps_limit = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_dd_blocksize = 1M {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_name_template = volume-%s {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_service_inithost_offload = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volume_usage_audit_period = month {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] zoning_mode = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_concurrency.disable_process_locking = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.auth_section = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.auth_type = password {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.auth_version = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.cache = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.delay_auth_decision = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.http_connect_timeout = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.include_service_catalog = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.insecure = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.interface = public {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_password = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86110) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 08:49:30 devstack cinder-volume[86110]: WARNING cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 08:49:30 devstack cinder-volume[86110]: WARNING cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Running cmd (subprocess): mount.quobyte {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcache_username = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.region_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.service_token_roles_required = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.service_type = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.token_cache_time = 300 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.188/identity {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.backend = dogpile.cache.null {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.backend_argument = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.backend_expiration_time = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.config_prefix = cache.oslo {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.debug_cache_backend = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.enable_retry_client = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.enable_socket_keepalive = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.expiration_time = 600 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.hashclient_retry_attempts = 2 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.memcache_dead_retry = 300 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.memcache_pool_maxsize = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.memcache_sasl_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.password = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.proxies = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.redis_db = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.redis_sentinel_service_name = mymaster {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.redis_server = localhost:6379 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.retry_attempts = 2 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.retry_delay = 0.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.socket_keepalive_count = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.socket_keepalive_idle = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.socket_keepalive_interval = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.socket_timeout = 1.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.tls_allowed_ciphers = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.tls_cafile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.tls_certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.tls_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.tls_keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cache.username = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] coordination.backend_url = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.asyncio_connection = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.asyncio_slave_connection = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.backend = sqlalchemy {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.connection = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.connection_debug = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.connection_parameters = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.connection_recycle_time = 3600 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.connection_trace = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.db_inc_retry_interval = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.db_max_retries = 20 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.db_max_retry_interval = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.db_retry_interval = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.max_overflow = 50 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.max_pool_size = 5 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.max_retries = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.mysql_wsrep_sync_wait = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.pool_timeout = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.retry_interval = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.slave_connection = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.sqlite_synchronous = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.synchronous_reader = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] database.use_db_reconnect = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_tracing.insecure = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.connection_string = messaging:// {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.es_doc_type = notification {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.es_scroll_size = 10000 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.es_scroll_time = 2m {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.filter_error_trace = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.hmac_keys = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.sentinel_service_name = mymaster {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.socket_timeout = 0.1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.trace_requests = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler.trace_sqlalchemy = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler_jaeger.process_tags = {} {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler_jaeger.service_name_prefix = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] profiler_otlp.service_name_prefix = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.enforce_new_defaults = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.policy_default_rule = default {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.policy_file = policy.yaml {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_policy.remote_timeout = 60.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] privsep_osbrick.group = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] privsep_osbrick.helper_command = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] privsep_osbrick.user = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_sys_admin.group = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_sys_admin.helper_command = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] cinder_sys_admin.user = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.auth_section = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.auth_type = password {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.cafile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.collect_timing = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.insecure = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.send_service_user_token = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.split_loggers = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.timeout = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.tls_ciphers = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] service_user.tls_min_version = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.auth_section = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.auth_type = password {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.collect_timing = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.insecure = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.region_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.split_loggers = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.timeout = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.tls_ciphers = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] glance.tls_min_version = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.backend_availability_zone = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.chap_password = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.chap_username = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.disk_geometry = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.driver_client_cert = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.driver_client_cert_key = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.driver_data_namespace = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.driver_use_ssl = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.enable_unsupported_driver = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.extra_capabilities = {} {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.filter_function = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.goodness_function = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.iscsi_target_flags = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.iscsi_write_cache = on {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.iser_helper = tgtadm {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.iser_ip_address = 192.168.122.188 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.iser_port = 3260 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_host = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_login = admin {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_mount_options = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_password = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_private_key = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_share_path = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_ssh_port = 22 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.num_shell_tries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.nvmet_port_id = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.quobyte_client_cfg = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.quobyte_volume_url = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.replication_device = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.report_discard_supported = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.reserved_percentage = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.scst_target_driver = iscsi {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.scst_target_iqn_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.storage_protocol = iSCSI {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.target_helper = tgtadm {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.target_ip_address = 192.168.122.188 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.target_port = 3260 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.target_protocol = iscsi {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.trace_flags = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.unique_fqdn_network = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.use_chap_auth = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_backend_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_clear = zero {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_clear_ionice = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_clear_size = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_reports.file_event_handler = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_reports.log_dir = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.backend_availability_zone = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.backend_host = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.chap_password = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.chap_username = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack quobyte-client[86111]: Reading configuration file: /etc/quobyte/client.cfg Nov 01 08:49:30 devstack quobyte-client[86111]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.chiscsi_conf = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.disk_geometry = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.driver_client_cert = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.driver_client_cert_key = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.driver_data_namespace = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] CMD "mount.quobyte" returned: 1 in 0.151s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.driver_use_ssl = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86110) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.extra_capabilities = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.filter_function = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[86110]: INFO cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e ... Nov 01 08:49:30 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 -c /etc/quobyte/client-cinder.cfg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.goodness_function = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.iscsi_target_flags = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.iscsi_write_cache = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.iser_helper = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.iser_ip_address = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.iser_port = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.iser_target_prefix = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_host = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_login = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_mount_options = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_password = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_private_key = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_share_path = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_ssh_port = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.num_shell_tries = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nvmet_ns_id = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.nvmet_port_id = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 -c /etc/quobyte/client-cinder.cfg Nov 01 08:49:30 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.replication_device = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.report_discard_supported = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.reserved_percentage = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.scst_target_driver = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.storage_protocol = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.target_helper = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.target_ip_address = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.target_port = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.target_prefix = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.target_protocol = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.trace_flags = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.unique_fqdn_network = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.use_chap_auth = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_clear = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_clear_ionice = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_clear_size = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] QuobyteHD.volumes_dir = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.ssl = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.ssl_version = {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_notifications.driver = [] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_notifications.retry = -1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] oslo_messaging_notifications.transport_url = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] key_manager.fixed_key = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.barbican_api_version = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.barbican_endpoint = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.barbican_endpoint_type = public {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.barbican_region_name = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.cafile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.collect_timing = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.insecure = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.number_of_retries = 60 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.retry_delay = 1 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.send_service_user_token = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.split_loggers = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.timeout = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.tls_ciphers = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.tls_min_version = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.verify_ssl = True {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican.verify_ssl_path = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.auth_section = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.auth_type = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.cafile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.certfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.collect_timing = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.insecure = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.keyfile = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.split_loggers = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.timeout = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.tls_ciphers = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] barbican_service_user.tls_min_version = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.approle_role_id = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.approle_secret_id = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.auth_method = approle {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.auth_path = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.kv_mountpoint = secret {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.kv_path = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.kv_version = 2 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.namespace = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.root_token_id = **** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.ssl_ca_crt_file = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.timeout = 60.0 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.token_file = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.token_role = None {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.use_ssl = False {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:30 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] ******************************************************************************** {{(pid=85893) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 08:49:31 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.425s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:31 devstack cinder-volume[86110]: INFO cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e succeeded Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86110) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.436s {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:31 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:49:31 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:49:31 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.227s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:31 devstack cinder-volume[86110]: INFO cinder.volume.driver [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.volume.driver [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9201431274414, 'free_capacity_gb': 1773.9201431274414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86110) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_db.sqlalchemy.engines [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86110) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG dbcounter [-] [86110] Writer thread running {{(pid=86110) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.db.api [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Building query based on filter {{(pid=86110) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.image.image_utils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86110) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 08:49:31 devstack cinder-volume[86110]: INFO cinder.keymgr.migration [None req-089870e4-de92-47b0-b974-79dba2c7f8ab None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86110) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86110) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:31 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:49:31 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:49:31 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.229s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.manager [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Notifying Schedulers of capabilities ... {{(pid=86110) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:49:31 devstack cinder-volume[86110]: INFO cinder.volume.manager [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Driver initialization completed successfully. Nov 01 08:49:31 devstack cinder-volume[86110]: INFO cinder.manager [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Initiating service 3 cleanup Nov 01 08:49:31 devstack cinder-volume[86110]: INFO cinder.manager [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Service 3 cleanup completed. Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.service [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Creating RPC server for service cinder-volume {{(pid=86110) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 08:49:31 devstack cinder-volume[86110]: DEBUG cinder.service [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86110) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 08:49:32 devstack cinder-volume[86110]: INFO cinder.volume.manager [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 08:49:32 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:49:32 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:49:32 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86110) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:49:32 devstack cinder-volume[86110]: DEBUG cinder.volume.drivers.quobyte [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86110) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:49:32 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86110) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:49:32 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:32 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:49:32 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:49:32 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Nov 01 08:49:32 devstack cinder-volume[86110]: DEBUG oslo_concurrency.processutils [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.242s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:32 devstack cinder-volume[86110]: INFO cinder.volume.manager [None req-db0be6a5-8469-49ac-af4e-9301931b4292 None None] Driver post RPC initialization completed successfully. Nov 01 08:49:36 devstack cinder-volume[85893]: INFO oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Caught SIGTERM, stopping children Nov 01 08:49:36 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Acquiring lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 08:49:36 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Acquired lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 08:49:36 devstack cinder-volume[85893]: DEBUG oslo_concurrency.lockutils [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Releasing lock "singleton_lock" {{(pid=85893) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 08:49:36 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Stop services. {{(pid=85893) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 08:49:36 devstack cinder-volume[85893]: DEBUG oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Killing children. {{(pid=85893) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 08:49:36 devstack cinder-volume[85893]: INFO oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Waiting on 1 children to exit Nov 01 08:49:40 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Acquiring lock "singleton_lock" {{(pid=86110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 08:49:40 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Acquired lock "singleton_lock" {{(pid=86110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 08:49:40 devstack cinder-volume[86110]: DEBUG oslo_concurrency.lockutils [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Releasing lock "singleton_lock" {{(pid=86110) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 08:49:40 devstack cinder-volume[86110]: WARNING amqp [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 08:49:40 devstack cinder-volume[86110]: WARNING amqp [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 08:49:40 devstack cinder-volume[85893]: INFO oslo_service.backend._eventlet.service [None req-9f7f5210-1e64-4906-bd69-afcdb8438fff None None] Child 86110 exited with status 0 Nov 01 08:49:40 devstack cinder-volume[86431]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 08:49:40 devstack cinder-volume[86431]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 08:49:40 devstack cinder-volume[86431]: we strongly recommend against using it for new projects. Nov 01 08:49:40 devstack cinder-volume[86431]: If you are already using Eventlet, we recommend migrating to a different Nov 01 08:49:40 devstack cinder-volume[86431]: framework. For more detail see Nov 01 08:49:40 devstack cinder-volume[86431]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 08:49:40 devstack cinder-volume[86431]: import eventlet # noqa Nov 01 08:49:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 08:49:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 08:49:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86431) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 08:49:44 devstack cinder-volume[86431]: INFO dbcounter [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Registered counter for database cinder Nov 01 08:49:44 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:44 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writer thread running {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 08:49:44 devstack cinder-volume[86431]: INFO cinder.rpc [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 08:49:44 devstack cinder-volume[86431]: INFO cinder.rpc [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 08:49:44 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Determined volume DB was empty at startup. Nov 01 08:49:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86431) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 08:49:44 devstack cinder-volume[86431]: WARNING stevedore.named [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 08:49:44 devstack cinder-volume[86431]: WARNING castellan.key_manager [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 08:49:44 devstack cinder-volume[86431]: WARNING cinder.keymgr.conf_key_mgr [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 08:49:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:45 devstack cinder-volume[86431]: INFO oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Starting 1 workers Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Started child 86770 {{(pid=86431) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Full set of CONF: {{(pid=86431) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] ******************************************************************************** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] Configuration options gathered from: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] ================================================================================ {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] allow_availability_zone_fallback = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] allow_compression_on_image_upload = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] allowed_direct_url_schemes = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] api_rate_limit = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] auth_strategy = keystone {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_host = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_stats_polling_interval = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backup_api_class = cinder.backup.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backup_name_template = backup-%s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backup_use_same_host = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backup_use_temp_snapshot = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] chap_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] chap_username = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_internal_tenant_project_id = 1f8ab8c55aae4d7f994e8688683c330f {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_internal_tenant_user_id = 93b97c85d5bb4bc58615e154fec4b5a0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cluster = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] compression_format = gzip {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] compute_api_class = cinder.compute.nova.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] config_dir = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] config_source = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] control_exchange = openstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] debug = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] default_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] default_group_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] default_volume_type = QuobyteHD {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] disk_geometry = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] driver_client_cert = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] driver_client_cert_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] driver_data_namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] driver_ssl_cert_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] driver_ssl_cert_verify = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] driver_use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] enable_new_services = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] enable_unsupported_driver = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] enabled_backends = ['QuobyteHD'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] enforce_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] filter_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_api_insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_api_servers = ['http://192.168.122.188/image'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_api_ssl_compression = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_ca_certificates_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_catalog_info = image:glance:publicURL {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_num_retries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance_request_timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] goodness_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] graceful_shutdown_timeout = 5 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] group_api_class = cinder.group.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] host = devstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_compress_on_upload = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_conversion_address_space_limit = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_conversion_cpu_limit = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_conversion_disable = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_introspection_address_space_limit = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_introspection_cpu_limit = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_upload_use_cinder_backend = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_upload_use_internal_tenant = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_volume_cache_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_volume_cache_max_count = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] image_volume_cache_max_size_gb = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] init_host_max_objects_retrieval = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] instance_format = [instance: %(uuid)s] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] iscsi_target_flags = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] iscsi_write_cache = on {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86770) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] iser_helper = tgtadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] iser_ip_address = 192.168.122.188 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] iser_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_color = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_config_append = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_dir = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_options = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_rotate_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_rotate_interval_type = days {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] log_rotation_type = none {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] max_age = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] max_logfile_count = 30 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] max_logfile_size_mb = 200 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] max_over_subscription_ratio = 20.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] message_reap_interval = 86400 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] message_ttl = 2592000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] migration_create_volume_timeout_secs = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] monkey_patch = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] monkey_patch_modules = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] my_ip = 192.168.122.188 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] no_snapshot_gb_quota = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] num_iser_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] num_shell_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] num_volume_device_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] nvmeof_conn_info_version = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] nvmet_ns_id = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] nvmet_port_id = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] osapi_max_limit = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] osapi_volume_ext_list = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] osapi_volume_listen = 0.0.0.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] osapi_volume_listen_port = 8776 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] osapi_volume_use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] osapi_volume_workers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] per_volume_size_limit = -1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] periodic_fuzzy_delay = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] periodic_interval = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] project_id_regex = [0-9a-f\-]+ {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] public_endpoint = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] publish_errors = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] quota_backup_gigabytes = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] quota_backups = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] quota_gigabytes = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] quota_groups = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] quota_snapshots = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] quota_volumes = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] rate_limit_burst = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] rate_limit_except_level = CRITICAL {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] rate_limit_interval = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] reinit_driver_count = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] replication_device = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] report_discard_supported = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] report_interval = 120 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] reservation_clean_interval = 86400 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] reservation_expire = 86400 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] reserved_image_namespaces = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] reserved_percentage = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] rpc_response_timeout = 120 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] run_external_periodic_tasks = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] scst_target_driver = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] scst_target_iqn_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_down_time = 720 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] shell_completion = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] snapshot_name_template = snapshot-%s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] state_path = /opt/stack/data/cinder {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] storage_availability_zone = nova {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] storage_protocol = iSCSI {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] syslog_log_facility = LOG_USER {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] target_helper = lioadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] target_ip_address = 192.168.122.188 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] target_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] target_protocol = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] target_secondary_ip_addresses = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] trace_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] transfer_api_class = cinder.transfer.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] transport_url = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] until_refresh = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] use_chap_auth = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] use_default_quota_class = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] use_journal = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] use_json = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] use_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] use_stderr = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] use_syslog = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] verify_glance_signatures = enabled {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_api_class = cinder.volume.api.API {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_backend_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_clear = zero {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_clear_ionice = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_clear_size = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_copy_bps_limit = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_dd_blocksize = 1M {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_name_template = volume-%s {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_service_inithost_offload = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volume_usage_audit_period = month {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] zoning_mode = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_concurrency.disable_process_locking = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86770) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.auth_type = password {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.auth_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.cache = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.delay_auth_decision = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.http_connect_timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.include_service_catalog = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.interface = public {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Running cmd (subprocess): mount.quobyte {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcache_username = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.region_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.service_token_roles_required = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.service_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.token_cache_time = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.188/identity {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.backend = dogpile.cache.null {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.backend_argument = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.backend_expiration_time = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.config_prefix = cache.oslo {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.debug_cache_backend = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.enable_retry_client = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.enable_socket_keepalive = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.expiration_time = 600 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.hashclient_retry_attempts = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.memcache_dead_retry = 300 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.memcache_pool_maxsize = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.memcache_sasl_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.proxies = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.redis_db = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.redis_sentinel_service_name = mymaster {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.redis_server = localhost:6379 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.retry_attempts = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.retry_delay = 0.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.socket_keepalive_count = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.socket_keepalive_idle = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.socket_keepalive_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.socket_timeout = 1.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.tls_allowed_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.tls_cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.tls_certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.tls_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.tls_keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cache.username = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] coordination.backend_url = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.asyncio_connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.asyncio_slave_connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.backend = sqlalchemy {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.connection_debug = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.connection_parameters = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.connection_recycle_time = 3600 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.connection_trace = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.db_inc_retry_interval = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.db_max_retries = 20 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.db_max_retry_interval = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.db_retry_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.max_overflow = 50 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.max_pool_size = 5 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.max_retries = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.mysql_wsrep_sync_wait = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.pool_timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.retry_interval = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.slave_connection = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.sqlite_synchronous = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.synchronous_reader = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] database.use_db_reconnect = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_tracing.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.connection_string = messaging:// {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.es_doc_type = notification {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.es_scroll_size = 10000 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.es_scroll_time = 2m {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.filter_error_trace = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.hmac_keys = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.sentinel_service_name = mymaster {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.socket_timeout = 0.1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.trace_requests = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler.trace_sqlalchemy = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler_jaeger.process_tags = {} {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler_jaeger.service_name_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] profiler_otlp.service_name_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.enforce_new_defaults = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.policy_default_rule = default {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.policy_file = policy.yaml {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_policy.remote_timeout = 60.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] privsep_osbrick.group = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] privsep_osbrick.helper_command = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] privsep_osbrick.user = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_sys_admin.group = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_sys_admin.helper_command = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] cinder_sys_admin.user = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.auth_type = password {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.send_service_user_token = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] service_user.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.auth_type = password {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.region_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack quobyte-client[86771]: Reading configuration file: /etc/quobyte/client.cfg Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] glance.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack quobyte-client[86771]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.backend_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.chap_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.chap_username = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.disk_geometry = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.driver_client_cert = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.driver_client_cert_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.driver_data_namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.driver_use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.enable_unsupported_driver = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.extra_capabilities = {} {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.filter_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.goodness_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.iscsi_target_flags = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.iscsi_write_cache = on {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.iser_helper = tgtadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.iser_ip_address = 192.168.122.188 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.iser_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_host = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_login = admin {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_mount_options = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_private_key = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_share_path = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_ssh_port = 22 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.num_shell_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.nvmet_port_id = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.quobyte_client_cfg = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.quobyte_volume_url = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.replication_device = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.report_discard_supported = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.reserved_percentage = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.scst_target_driver = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.scst_target_iqn_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.storage_protocol = iSCSI {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.target_helper = tgtadm {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.target_ip_address = 192.168.122.188 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.target_port = 3260 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.target_protocol = iscsi {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.trace_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.unique_fqdn_network = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.use_chap_auth = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_backend_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_clear = zero {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_clear_ionice = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_clear_size = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_reports.file_event_handler = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_reports.log_dir = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.backend_availability_zone = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.backend_host = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.chap_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.chap_username = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.chiscsi_conf = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.disk_geometry = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.driver_client_cert = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.driver_client_cert_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.driver_data_namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.driver_use_ssl = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.extra_capabilities = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.filter_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.goodness_function = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.iscsi_target_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.iscsi_write_cache = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.iser_helper = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.iser_ip_address = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.iser_port = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.iser_target_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_host = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_login = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_mount_options = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_password = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_private_key = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_share_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_ssh_port = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.num_shell_tries = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nvmet_ns_id = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.nvmet_port_id = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.replication_device = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.report_discard_supported = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.reserved_percentage = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.scst_target_driver = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.storage_protocol = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.target_helper = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.target_ip_address = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.target_port = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.target_prefix = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.target_protocol = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.trace_flags = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.unique_fqdn_network = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.use_chap_auth = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_clear = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_clear_ionice = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_clear_size = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] QuobyteHD.volumes_dir = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.ssl_version = {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_notifications.driver = [] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_notifications.retry = -1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] oslo_messaging_notifications.transport_url = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] key_manager.fixed_key = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.barbican_api_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.barbican_endpoint = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.barbican_endpoint_type = public {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.barbican_region_name = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.number_of_retries = 60 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.retry_delay = 1 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.send_service_user_token = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.verify_ssl = True {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican.verify_ssl_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.auth_section = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.auth_type = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.cafile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.certfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.collect_timing = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.insecure = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.keyfile = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.split_loggers = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.timeout = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.tls_ciphers = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] barbican_service_user.tls_min_version = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.approle_role_id = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.approle_secret_id = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.auth_method = approle {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.auth_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.kv_mountpoint = secret {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.kv_path = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.kv_version = 2 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.namespace = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.root_token_id = **** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.ssl_ca_crt_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.timeout = 60.0 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.token_file = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.token_role = None {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.use_ssl = False {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 08:49:45 devstack cinder-volume[86431]: DEBUG oslo_service.backend._eventlet.service [None req-c834f9f9-abcb-4440-a7fa-d3d0d6fc3cae None None] ******************************************************************************** {{(pid=86431) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 08:49:45 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.volume.driver [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Driver hasn't implemented _init_vendor_properties() Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.driver [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9201431274414, 'free_capacity_gb': 1773.9201431274414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86770) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writer thread running {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.db.api [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Building query based on filter {{(pid=86770) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86770) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.keymgr.migration [None req-d8fcb4ee-f67d-4a05-a70d-4bef6ff8b4c8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 08:49:45 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:49:45 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:49:45 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.241s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Driver initialization completed successfully. Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.manager [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Initiating service 3 cleanup Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.manager [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Service 3 cleanup completed. Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.service [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Creating RPC server for service cinder-volume {{(pid=86770) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.service [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86770) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 08:49:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:49:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:49:46 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:49:46 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:49:46 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Nov 01 08:49:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.248s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:49:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c47b616e-8f18-43f0-b3d0-f0f226691dbd None None] Driver post RPC initialization completed successfully. Nov 01 08:49:55 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:49:55 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:49:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:50:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:50:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 6 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:50:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Flow 'volume_create_manager' (78796db0-646c-485a-99a2-37534e0328d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c4645-d27a-42b2-a375-16d256ad3c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c4645-d27a-42b2-a375-16d256ad3c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-203422066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7319fb5-2cd4-42fc-825c-0893f3282131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f57155efa8b4a3b8d3aa06a26de882f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:50:43Z,use_quota=True,user_id='89e22497edc647a9803843ebb8821954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b76387d-32f1-481a-831b-2c30c1614086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b76387d-32f1-481a-831b-2c30c1614086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4ef57f-56f2-475c-bea1-b9df9c06e72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4ef57f-56f2-475c-bea1-b9df9c06e72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7319fb5-2cd4-42fc-825c-0893f3282131', 'volume_name': 'volume-c7319fb5-2cd4-42fc-825c-0893f3282131', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f596f11-ea55-4725-afb8-1a45048379b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f596f11-ea55-4725-afb8-1a45048379b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ec5575-bd6d-48ed-9890-c1052b87212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Volume c7319fb5-2cd4-42fc-825c-0893f3282131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7319fb5-2cd4-42fc-825c-0893f3282131', 'volume_size': 1} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-203422066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7319fb5-2cd4-42fc-825c-0893f3282131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f57155efa8b4a3b8d3aa06a26de882f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:50:43Z,use_quota=True,user_id='89e22497edc647a9803843ebb8821954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Creating volume c7319fb5-2cd4-42fc-825c-0893f3282131 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:50:43 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:43 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 1073741824 Nov 01 08:50:43 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Flow 'volume_create_manager' (b1610c3c-5857-45ad-824c-82028cbbb2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a754f0b7-218a-4cc9-a562-315ef9d4479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Flow 'volume_create_manager' (08fbe795-0c97-4d90-bf90-27f9a4eb59e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9d0cec-0510-421e-b287-5bad08846155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a754f0b7-218a-4cc9-a562-315ef9d4479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-575775248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4af00ab0b294f98b991f0ff1cfe677c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:50:43Z,use_quota=True,user_id='a701b910988846a68e4a7e50decf2603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267f478d-74e6-43ad-a0ef-f9e5a07523b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267f478d-74e6-43ad-a0ef-f9e5a07523b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4c4a44-96e8-49d7-b00b-23edc5f30ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4c4a44-96e8-49d7-b00b-23edc5f30ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3', 'volume_name': 'volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd79cd7a-e43a-4285-ad99-403a5a645815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd79cd7a-e43a-4285-ad99-403a5a645815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62eb144-8332-4731-b733-a7c20eaa24d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Volume 8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3', 'volume_size': 1} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9d0cec-0510-421e-b287-5bad08846155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1837269925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78dda26-5f90-4406-9b21-2bfad75106e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4d3b7011f94c0c9537d89c22a7a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:50:43Z,use_quota=True,user_id='15d40d1707dd4569b2ff11295e6c90a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b18374-99f6-4948-acac-fb98c13f8b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b18374-99f6-4948-acac-fb98c13f8b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511350c1-fb79-4529-93ec-4bb9cbd2c04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511350c1-fb79-4529-93ec-4bb9cbd2c04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78dda26-5f90-4406-9b21-2bfad75106e9', 'volume_name': 'volume-d78dda26-5f90-4406-9b21-2bfad75106e9', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7193b2a7-f611-48d3-bbbd-ca7a63b44c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7193b2a7-f611-48d3-bbbd-ca7a63b44c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9706a999-688c-4f77-bd9d-e5aad899c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:43 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Volume d78dda26-5f90-4406-9b21-2bfad75106e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78dda26-5f90-4406-9b21-2bfad75106e9', 'volume_size': 1} Nov 01 08:50:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:44 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 1073741824" returned: 0 in 0.557s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:44 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 Nov 01 08:50:44 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:44 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131" returned: 0 in 0.325s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.732s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-575775248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4af00ab0b294f98b991f0ff1cfe677c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:50:43Z,use_quota=True,user_id='a701b910988846a68e4a7e50decf2603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Creating volume 8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:50:44 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ec5575-bd6d-48ed-9890-c1052b87212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7319fb5-2cd4-42fc-825c-0893f3282131', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:44 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 1073741824 Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2ef100-3659-4e92-94c0-a571e741df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:44 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:44 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Volume volume-c7319fb5-2cd4-42fc-825c-0893f3282131 (c7319fb5-2cd4-42fc-825c-0893f3282131): created successfully Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2ef100-3659-4e92-94c0-a571e741df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Flow 'volume_create_manager' (78796db0-646c-485a-99a2-37534e0328d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:50:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1ba2b320-669e-4ee3-9125-6330ed0e9fac tempest-DeleteServersTestJSON-1575199295 None] Created volume successfully. Nov 01 08:50:45 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 1073741824" returned: 0 in 0.735s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:45 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 Nov 01 08:50:45 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:45 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" returned: 0 in 0.267s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.712s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1837269925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78dda26-5f90-4406-9b21-2bfad75106e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4d3b7011f94c0c9537d89c22a7a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:50:43Z,use_quota=True,user_id='15d40d1707dd4569b2ff11295e6c90a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Creating volume d78dda26-5f90-4406-9b21-2bfad75106e9 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:50:45 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62eb144-8332-4731-b733-a7c20eaa24d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95177905-82df-44c2-bb23-6591f1a42b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:45 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 1073741824 Nov 01 08:50:45 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:45 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Volume volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 (8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3): created successfully Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95177905-82df-44c2-bb23-6591f1a42b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Flow 'volume_create_manager' (b1610c3c-5857-45ad-824c-82028cbbb2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:50:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-7a10632f-e1fd-42f2-8939-9757f3311374 req-cd4bb504-730c-4b42-bc46-93fae86b36f1 tempest-VolumesSnapshotsTestJSON-287412887 None] Created volume successfully. Nov 01 08:50:46 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 1073741824" returned: 0 in 0.555s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:46 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 Nov 01 08:50:46 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:46 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9" returned: 0 in 0.397s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9706a999-688c-4f77-bd9d-e5aad899c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78dda26-5f90-4406-9b21-2bfad75106e9', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955ad9a5-073d-42d9-8944-40dd7b7ac8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:50:46 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Volume volume-d78dda26-5f90-4406-9b21-2bfad75106e9 (d78dda26-5f90-4406-9b21-2bfad75106e9): created successfully Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955ad9a5-073d-42d9-8944-40dd7b7ac8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:50:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Flow 'volume_create_manager' (08fbe795-0c97-4d90-bf90-27f9a4eb59e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:50:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ebf56011-a309-4d01-8d4c-43945808f9fc tempest-TaggedAttachmentsTest-402349138 None] Created volume successfully. Nov 01 08:50:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Creating offline snapshot 7df792c9-0264-4cb3-9a52-7b1018f78ee1 of volume 8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:50:47 devstack cinder-volume[86770]: INFO oslo.privsep.daemon [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_3cs0hwz/privsep.sock'] Nov 01 08:50:47 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_3cs0hwz/privsep.sock Nov 01 08:50:47 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 08:50:48 devstack cinder-volume[86770]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 01 08:50:49 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:49 devstack cinder-volume[86770]: INFO oslo.privsep.daemon [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Spawned new privsep daemon via rootwrap Nov 01 08:50:49 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Accepted privsep connection to /tmp/tmp_3cs0hwz/privsep.sock {{(pid=86770) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 01 08:50:49 devstack cinder-volume[86770]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 01 08:50:49 devstack cinder-volume[86770]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 01 08:50:49 devstack cinder-volume[86770]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 01 08:50:49 devstack cinder-volume[86770]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87706 Nov 01 08:50:49 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[91805c8d-9d69-483a-9600-e37143000011]: (2,) {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:50:49 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d8f723-a147-40a4-a9da-eda5e56cd1ed]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:50:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:49 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 Nov 01 08:50:49 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:49 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" returned: 0 in 0.433s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:49 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 1G Nov 01 08:50:49 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:50 devstack cinder-volume[86770]: WARNING py.warnings [req-1bb36204-0958-4824-8169-52b93d3c36c9 req-2a9d6967-b7ec-4bcb-b133-c715706280c4 tempest-DeleteServersTestJSON-1575199295 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 01 08:50:50 devstack cinder-volume[86770]: .first() Nov 01 08:50:50 devstack cinder-volume[86770]: Nov 01 08:50:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-1bb36204-0958-4824-8169-52b93d3c36c9 req-2a9d6967-b7ec-4bcb-b133-c715706280c4 tempest-DeleteServersTestJSON-1575199295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:50 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 1G" returned: 0 in 0.608s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:50 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 Nov 01 08:50:50 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:50 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1" returned: 0 in 0.324s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:50 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 is being set with open permissions: ugo+rw Nov 01 08:50:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:50 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 Nov 01 08:50:50 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:51 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1" returned: 0 in 0.327s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:51 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.info Nov 01 08:50:51 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:51 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.info" returned: 0 in 0.279s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:51 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.info is being set with open permissions: ugo+rw Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:51 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.info Nov 01 08:50:51 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:51 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.info" returned: 0 in 0.264s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.612s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-1bb36204-0958-4824-8169-52b93d3c36c9 req-2a9d6967-b7ec-4bcb-b133-c715706280c4 tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.450s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-1bb36204-0958-4824-8169-52b93d3c36c9 req-2a9d6967-b7ec-4bcb-b133-c715706280c4 tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-12bb7a18-42de-442d-8da4-65bb27e914c6 req-2852b490-e9f4-4074-8d4f-45ac6a8286a9 tempest-VolumesSnapshotsTestJSON-287412887 None] Create snapshot completed successfully Nov 01 08:50:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-1bb36204-0958-4824-8169-52b93d3c36c9 req-2a9d6967-b7ec-4bcb-b133-c715706280c4 tempest-DeleteServersTestJSON-1575199295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-c7319fb5-2cd4-42fc-825c-0893f3282131', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86208eac-eb0c-41b9-84f3-8c82d6c09dcd', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:50:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-1bb36204-0958-4824-8169-52b93d3c36c9 req-2a9d6967-b7ec-4bcb-b133-c715706280c4 tempest-DeleteServersTestJSON-1575199295 None] attachment_update completed successfully. Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "cinder-7df792c9-0264-4cb3-9a52-7b1018f78ee1-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-7df792c9-0264-4cb3-9a52-7b1018f78ee1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "cinder-quobyte-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-quobyte-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "cinder-quobyte-7df792c9-0264-4cb3-9a52-7b1018f78ee1" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-quobyte-7df792c9-0264-4cb3-9a52-7b1018f78ee1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Deleting offline snapshot 7df792c9-0264-4cb3-9a52-7b1018f78ee1 of volume 8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] snapshot_file for this snap is: volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a767a3-db54-4d79-92c3-2b985856d730]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:52 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 Nov 01 08:50:52 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:52 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1" returned: 0 in 0.536s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc17111-d666-463c-9d49-58419ad31a60]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:50:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:53 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 Nov 01 08:50:53 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:53 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" returned: 0 in 0.612s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:53 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 Nov 01 08:50:53 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:54 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1" returned: 0 in 0.645s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:54 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1 Nov 01 08:50:54 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:54 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3.7df792c9-0264-4cb3-9a52-7b1018f78ee1" returned: 0 in 0.487s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-quobyte-7df792c9-0264-4cb3-9a52-7b1018f78ee1" released by "_delete_snapshot" :: held 2.482s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:50:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-quobyte-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" released by "delete_snapshot" :: held 2.528s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:50:54 devstack cinder-volume[86770]: WARNING cinder.quota [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:50:54 devstack cinder-volume[86770]: WARNING cinder.quota [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:50:55 devstack cinder-volume[86770]: DEBUG cinder.quota [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Created reservations ['3ec0b053-7fbd-4ea7-a8f0-070d51882b25', '9deba441-ba74-48fe-a710-b96a1dec55ba', '44252c55-c361-473f-8b6e-7e0bc905ffc7', 'e9f712f0-9bcc-454e-a08e-c325a1f26398'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:50:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Delete snapshot completed successfully. Nov 01 08:50:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-39b78a55-080a-486e-9a73-19fd8d0f8d67 req-4c1e00af-f148-4594-afbe-2caf6b3b0a3e tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-7df792c9-0264-4cb3-9a52-7b1018f78ee1-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:50:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "cinder-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:50:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:50:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "cinder-quobyte-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:50:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-quobyte-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" acquired by "delete_volume" :: waited 0.058s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:50:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f821cb-a049-4356-97ff-b309433cb813]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:50:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-932865a3-afae-4ba9-ad38-c5f36a6c3231 req-4feeb354-bfb4-4299-89fe-a3dde539df7d tempest-DeleteServersTestJSON-1575199295 None] Terminate volume connection completed successfully. Nov 01 08:50:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-932865a3-afae-4ba9-ad38-c5f36a6c3231 req-4feeb354-bfb4-4299-89fe-a3dde539df7d tempest-DeleteServersTestJSON-1575199295 None] Deleting attachment 86208eac-eb0c-41b9-84f3-8c82d6c09dcd. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:50:56 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 Nov 01 08:50:56 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:56 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" returned: 0 in 0.456s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:56 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3 Nov 01 08:50:56 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:57 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" returned: 0 in 0.450s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-quobyte-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3" released by "delete_volume" :: held 1.053s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:50:57 devstack cinder-volume[86770]: WARNING cinder.quota [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG cinder.quota [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Created reservations ['cddee1b8-05d9-4470-bb92-ceb53ab2a2c0', '17ea4614-c781-4bfe-92d0-8aa214feea91', '95157c19-7d46-4779-abf9-bc06e7657a7c', '93b18f14-f394-4d2b-81c2-23b5c352094a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:57 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:50:57 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:57 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.294s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG cinder.manager [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:50:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Deleted volume successfully. Nov 01 08:50:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-26a06be2-6e0e-47ce-9bc3-15dfa71599e2 req-d61b3ee3-3c87-4eed-9184-9b8156e0678b tempest-VolumesSnapshotsTestJSON-287412887 None] Lock "cinder-8e7408f5-2b7a-4ab0-8de2-4e6b49ef54d3-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Acquiring lock "cinder-c7319fb5-2cd4-42fc-825c-0893f3282131-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Lock "cinder-c7319fb5-2cd4-42fc-825c-0893f3282131-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Acquiring lock "cinder-quobyte-c7319fb5-2cd4-42fc-825c-0893f3282131" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Lock "cinder-quobyte-c7319fb5-2cd4-42fc-825c-0893f3282131" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da8378-36f0-4561-9c0f-f384130f23e0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:59 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 Nov 01 08:50:59 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:59 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131" returned: 0 in 0.408s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:50:59 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131 Nov 01 08:50:59 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:50:59 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c7319fb5-2cd4-42fc-825c-0893f3282131" returned: 0 in 0.313s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:50:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Lock "cinder-quobyte-c7319fb5-2cd4-42fc-825c-0893f3282131" released by "delete_volume" :: held 0.800s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Created reservations ['fa7d6373-fa6b-44ec-885d-95497283ec01', '389da792-fd9c-4967-a9be-5426ff035b42', '8aafdf0f-a133-4fd6-a50b-c2fc06d397d0', '3428234d-3037-45b3-b1ae-eb98137a0c7e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:00 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:51:00 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:00 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.652s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:00 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:51:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Deleted volume successfully. Nov 01 08:51:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a171898a-ceb2-4f8d-a0b7-e680464f1955 tempest-DeleteServersTestJSON-1575199295 None] Lock "cinder-c7319fb5-2cd4-42fc-825c-0893f3282131-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Flow 'volume_create_manager' (fe8923cb-bdf4-49fc-92f0-42f7d0efe481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b8a658-0cd1-4844-8f8d-5b9825a95cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b8a658-0cd1-4844-8f8d-5b9825a95cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2043312419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b5400d-6ad4-4508-b42a-4790e2d6d84b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14946f4c2de14720bd8a5bfc0edb1e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:04Z,use_quota=True,user_id='68bbf3fb56a8476da188626b5120813a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c1055c-20e8-4168-981a-59cd33815aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c1055c-20e8-4168-981a-59cd33815aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7adc9c4-d0de-44b0-bd01-68b4deb27db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7adc9c4-d0de-44b0-bd01-68b4deb27db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b5400d-6ad4-4508-b42a-4790e2d6d84b', 'volume_name': 'volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96aa6cb5-ecc9-4501-ae10-0140eff8e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96aa6cb5-ecc9-4501-ae10-0140eff8e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64daff8a-a4f3-4f5d-8182-8de150749862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:03 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Volume 54b5400d-6ad4-4508-b42a-4790e2d6d84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b', 'volume_size': 1} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2043312419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b5400d-6ad4-4508-b42a-4790e2d6d84b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='14946f4c2de14720bd8a5bfc0edb1e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:04Z,use_quota=True,user_id='68bbf3fb56a8476da188626b5120813a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Creating volume 54b5400d-6ad4-4508-b42a-4790e2d6d84b {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:51:03 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:51:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:03 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b 1073741824 Nov 01 08:51:03 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:04 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b 1073741824" returned: 0 in 0.613s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:04 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b Nov 01 08:51:04 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:04 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b" returned: 0 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:51:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64daff8a-a4f3-4f5d-8182-8de150749862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6014839f-12f0-4df3-bc1c-8eaa6e597c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Volume volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b (54b5400d-6ad4-4508-b42a-4790e2d6d84b): created successfully Nov 01 08:51:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6014839f-12f0-4df3-bc1c-8eaa6e597c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Flow 'volume_create_manager' (fe8923cb-bdf4-49fc-92f0-42f7d0efe481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-2f62ae27-2d49-416e-bb13-4b28bfc41160 req-45be4de3-cecd-4734-9384-36e17a83eb69 tempest-VolumesGetTestJSON-1324406724 None] Created volume successfully. Nov 01 08:51:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Acquiring lock "cinder-54b5400d-6ad4-4508-b42a-4790e2d6d84b-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Lock "cinder-54b5400d-6ad4-4508-b42a-4790e2d6d84b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Acquiring lock "cinder-quobyte-54b5400d-6ad4-4508-b42a-4790e2d6d84b" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Lock "cinder-quobyte-54b5400d-6ad4-4508-b42a-4790e2d6d84b" acquired by "delete_volume" :: waited 0.049s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:07 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f6a4e6-4686-4b12-82fb-d3bf4d4ce588]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:07 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b Nov 01 08:51:07 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:07 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b" returned: 0 in 0.492s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:07 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b Nov 01 08:51:07 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:08 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54b5400d-6ad4-4508-b42a-4790e2d6d84b" returned: 0 in 0.586s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Lock "cinder-quobyte-54b5400d-6ad4-4508-b42a-4790e2d6d84b" released by "delete_volume" :: held 1.198s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG cinder.quota [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Created reservations ['12f9e32a-b6b5-44fc-afb0-da64b6ec4784', 'dd000852-3f50-47a8-b19f-5da4adbf201d', 'e82c3347-1c5c-4391-b373-7030a5250e4c', 'edb9770b-cc25-4c3e-9cf7-2d8864a7a7c3'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:08 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:51:08 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:08 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.447s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG cinder.manager [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:51:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Deleted volume successfully. Nov 01 08:51:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e1502646-fbc8-4fdf-a23d-f9af1ee92a47 req-a9fd1228-11a9-49d3-9c24-33900e38858b tempest-VolumesGetTestJSON-1324406724 None] Lock "cinder-54b5400d-6ad4-4508-b42a-4790e2d6d84b-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fbeb70fc-27ac-46a3-b064-1bc2fa07300f tempest-BackendsCapabilitiesAdminTestsJSON-1505919539 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9201431274414, 'free_capacity_gb': 1773.9201431274414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86770) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 08:51:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7a9c0fe8-e4ab-47be-82ae-7cc3b03ce218 tempest-BackendsCapabilitiesAdminTestsJSON-1505919539 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9201431274414, 'free_capacity_gb': 1773.9201431274414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86770) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 08:51:18 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=47,cinder:SELECT=42,cinder:DELETE=1,cinder:INSERT=9 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:51:18 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=37,cinder:UPDATE=42,cinder:INSERT=12,cinder:DELETE=7 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:21 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:51:21 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:21 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.456s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 8 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:51:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:51:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2357a9e7-f3ae-4ad7-b07c-464efd090ce8 tempest-GroupSnapshotsV319Test-1357468912 None] Group tempest-GroupSnapshotsV319Test-Group-1458135799: creating Nov 01 08:51:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2357a9e7-f3ae-4ad7-b07c-464efd090ce8 tempest-GroupSnapshotsV319Test-1357468912 None] Group tempest-GroupSnapshotsV319Test-Group-1458135799: created successfully Nov 01 08:51:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2357a9e7-f3ae-4ad7-b07c-464efd090ce8 tempest-GroupSnapshotsV319Test-1357468912 None] Create group completed successfully. Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Flow 'volume_create_manager' (cc8a53e2-295d-4eab-b4f2-51e451194fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd0a2a0-b81c-44a2-9f22-03bd7d4c7c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd0a2a0-b81c-44a2-9f22-03bd7d4c7c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1920796617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c72d62f6-32bc-480e-b47f-75ad208d0f58,host='devstack@QuobyteHD#QuobyteHD',id=ec3b39e6-7e0a-4492-8d15-6e0c13878cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d6584309a61452f92618ca5bb620332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:27Z,use_quota=True,user_id='710be13505b240d4895c0eab1dfbec03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738d6fce-5214-4fda-9c77-3ddbc20ec3fa),volume_type_id=738d6fce-5214-4fda-9c77-3ddbc20ec3fa)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409cf67b-ac36-4fcf-8ea6-0fa901eaabd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409cf67b-ac36-4fcf-8ea6-0fa901eaabd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938dd7a7-246f-41ce-897b-82868c209fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938dd7a7-246f-41ce-897b-82868c209fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3b39e6-7e0a-4492-8d15-6e0c13878cab', 'volume_name': 'volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a26f0e-00c9-47db-96a1-a2c8e9434203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a26f0e-00c9-47db-96a1-a2c8e9434203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8424f-6c37-43ed-b187-1af77b5f56f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Volume ec3b39e6-7e0a-4492-8d15-6e0c13878cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab', 'volume_size': 1} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c72d62f6-32bc-480e-b47f-75ad208d0f58,created_at=2026-11-01T07:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1920796617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c72d62f6-32bc-480e-b47f-75ad208d0f58,host='devstack@QuobyteHD#QuobyteHD',id=ec3b39e6-7e0a-4492-8d15-6e0c13878cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d6584309a61452f92618ca5bb620332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:27Z,use_quota=True,user_id='710be13505b240d4895c0eab1dfbec03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738d6fce-5214-4fda-9c77-3ddbc20ec3fa),volume_type_id=738d6fce-5214-4fda-9c77-3ddbc20ec3fa)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Creating volume ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:51:27 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:27 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab 1073741824 Nov 01 08:51:27 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:27 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab 1073741824" returned: 0 in 0.483s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:27 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab Nov 01 08:51:27 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:27 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" returned: 0 in 0.278s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8424f-6c37-43ed-b187-1af77b5f56f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1dd758-f229-4fc8-93ef-ea7f013c75fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Volume volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab (ec3b39e6-7e0a-4492-8d15-6e0c13878cab): created successfully Nov 01 08:51:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1dd758-f229-4fc8-93ef-ea7f013c75fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Flow 'volume_create_manager' (cc8a53e2-295d-4eab-b4f2-51e451194fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-db340840-993e-4851-afd2-5d4a228aa502 tempest-GroupSnapshotsV319Test-1357468912 None] Created volume successfully. Nov 01 08:51:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] GroupSnapshot 640820f7-480f-40d2-a0be-5db12ab9779d: creating. Nov 01 08:51:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Group snapshot 640820f7-480f-40d2-a0be-5db12ab9779d: creating. {{(pid=86770) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 08:51:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Creating offline snapshot b4d98528-ce6c-4793-bb21-02de48e4a4d9 of volume ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:51:29 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86cc35-153d-4326-800a-de91b36ae145]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:29 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab Nov 01 08:51:29 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:29 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:29 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 1G Nov 01 08:51:29 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:29 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 1G" returned: 0 in 0.461s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:29 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 Nov 01 08:51:29 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a0783a22-1c71-46ba-b34e-9a1e53ed0ca3 tempest-GroupsTest-121484764 None] Group tempest-Group1-219907116: creating Nov 01 08:51:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a0783a22-1c71-46ba-b34e-9a1e53ed0ca3 tempest-GroupsTest-121484764 None] Group tempest-Group1-219907116: created successfully Nov 01 08:51:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a0783a22-1c71-46ba-b34e-9a1e53ed0ca3 tempest-GroupsTest-121484764 None] Create group completed successfully. Nov 01 08:51:30 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9" returned: 0 in 0.391s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:30 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 08:51:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:30 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 Nov 01 08:51:30 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:30 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:30 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.info Nov 01 08:51:30 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:30 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.info" returned: 0 in 0.314s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:30 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 08:51:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:30 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.info Nov 01 08:51:30 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:31 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.info" returned: 0 in 0.388s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d7e86912-e418-4ff1-acaa-a03f160aaa38 tempest-GroupsTest-121484764 None] Group tempest-Group2-972648691: creating Nov 01 08:51:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5f351d5a-116f-48f8-9d37-7d3571a9ec7a tempest-GroupSnapshotsV319Test-1357468912 None] group_snapshot 640820f7-480f-40d2-a0be-5db12ab9779d: created successfully Nov 01 08:51:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d7e86912-e418-4ff1-acaa-a03f160aaa38 tempest-GroupsTest-121484764 None] Group tempest-Group2-972648691: created successfully Nov 01 08:51:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d7e86912-e418-4ff1-acaa-a03f160aaa38 tempest-GroupsTest-121484764 None] Create group completed successfully. Nov 01 08:51:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] group_snapshot 640820f7-480f-40d2-a0be-5db12ab9779d: deleting Nov 01 08:51:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] group_snapshot 640820f7-480f-40d2-a0be-5db12ab9779d: deleting {{(pid=86770) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Acquiring lock "cinder-quobyte-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Lock "cinder-quobyte-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Acquiring lock "cinder-quobyte-b4d98528-ce6c-4793-bb21-02de48e4a4d9" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Lock "cinder-quobyte-b4d98528-ce6c-4793-bb21-02de48e4a4d9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Deleting offline snapshot b4d98528-ce6c-4793-bb21-02de48e4a4d9 of volume ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] snapshot_file for this snap is: volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bd1984-9a96-4062-a9b6-def897cd245e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Flow 'volume_create_manager' (6c281491-af94-49e1-aefc-df59bd9e03b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6666f348-2253-4258-925d-6257e7a3c149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6666f348-2253-4258-925d-6257e7a3c149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578954894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c57b386b-e11e-4be2-9539-7d0c5cb3e99e,host='devstack@QuobyteHD#QuobyteHD',id=c28102f8-dc06-468a-9dba-354124066460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bed2e46da84a639129fadc541f841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:33Z,use_quota=True,user_id='7f45db3a95584966860cbd87ba775c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caa60b44-d579-4f3b-8a68-82560af1f529),volume_type_id=caa60b44-d579-4f3b-8a68-82560af1f529)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23213547-5a6a-4df9-a0c5-630fbbf6381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23213547-5a6a-4df9-a0c5-630fbbf6381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989cfe82-fa4c-4b5a-a91b-acf3d5e03040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:33 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 Nov 01 08:51:33 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989cfe82-fa4c-4b5a-a91b-acf3d5e03040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c28102f8-dc06-468a-9dba-354124066460', 'volume_name': 'volume-c28102f8-dc06-468a-9dba-354124066460', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd10c17-3306-4a50-94be-784d1ac32aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd10c17-3306-4a50-94be-784d1ac32aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebea30f-4374-4c9d-add5-c09e084f97c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:33 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Volume c28102f8-dc06-468a-9dba-354124066460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c28102f8-dc06-468a-9dba-354124066460', 'volume_size': 1} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c57b386b-e11e-4be2-9539-7d0c5cb3e99e,created_at=2026-11-01T07:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1578954894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c57b386b-e11e-4be2-9539-7d0c5cb3e99e,host='devstack@QuobyteHD#QuobyteHD',id=c28102f8-dc06-468a-9dba-354124066460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bed2e46da84a639129fadc541f841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:33Z,use_quota=True,user_id='7f45db3a95584966860cbd87ba775c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(caa60b44-d579-4f3b-8a68-82560af1f529),volume_type_id=caa60b44-d579-4f3b-8a68-82560af1f529)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Creating volume c28102f8-dc06-468a-9dba-354124066460 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:51:33 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:33 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 1073741824 Nov 01 08:51:33 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:33 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9" returned: 0 in 0.689s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e8933e-50b3-489c-b025-54d2fe973651]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:34 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab Nov 01 08:51:34 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:34 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 1073741824" returned: 0 in 0.639s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:34 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 Nov 01 08:51:34 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:34 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" returned: 0 in 0.513s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:34 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 Nov 01 08:51:34 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:34 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460" returned: 0 in 0.545s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebea30f-4374-4c9d-add5-c09e084f97c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c28102f8-dc06-468a-9dba-354124066460', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ac7ea5-9266-4b2d-ac22-c25795094934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:34 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Volume volume-c28102f8-dc06-468a-9dba-354124066460 (c28102f8-dc06-468a-9dba-354124066460): created successfully Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ac7ea5-9266-4b2d-ac22-c25795094934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Flow 'volume_create_manager' (6c281491-af94-49e1-aefc-df59bd9e03b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:34 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d0b2c53d-7dbd-4768-be3e-890664f384a5 tempest-GroupsTest-121484764 None] Created volume successfully. Nov 01 08:51:34 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9" returned: 0 in 0.503s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:34 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9 Nov 01 08:51:34 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:35 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab.b4d98528-ce6c-4793-bb21-02de48e4a4d9" returned: 0 in 0.361s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Lock "cinder-quobyte-b4d98528-ce6c-4793-bb21-02de48e4a4d9" released by "_delete_snapshot" :: held 2.238s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Lock "cinder-quobyte-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" released by "delete_snapshot" :: held 2.282s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:35 devstack cinder-volume[86770]: WARNING cinder.quota [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1197653268 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1197653268, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:51:35 devstack cinder-volume[86770]: WARNING cinder.quota [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1197653268 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1197653268, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:51:35 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] Created reservations ['9a042c37-75e4-416a-bbde-baf92671458e', '190f3fa2-ee84-47cc-901a-1c71e0c74399', '422363bc-e243-4451-85a9-7dd46b12e642', '8a5b2277-b056-4465-8675-bceaaf0200a8'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4cbcf320-2abe-4519-8c0e-2b710e144a8a tempest-GroupSnapshotsV319Test-1357468912 None] group_snapshot 640820f7-480f-40d2-a0be-5db12ab9779d: deleted successfully Nov 01 08:51:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Acquiring lock "cinder-quobyte-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Lock "cinder-quobyte-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ae779-61b6-4ecd-91da-13bb56492959]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:36 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab Nov 01 08:51:36 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:36 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" returned: 0 in 0.735s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:36 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab Nov 01 08:51:36 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:37 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" returned: 0 in 0.381s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Lock "cinder-quobyte-ec3b39e6-7e0a-4492-8d15-6e0c13878cab" released by "delete_volume" :: held 1.235s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Created reservations ['424743eb-2504-46dc-b43e-8493a07d479d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:37 devstack cinder-volume[86770]: WARNING cinder.quota [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1197653268 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1197653268, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Created reservations ['75963da3-b4bf-4fc3-8f41-b5b79d8adb23', '64c7fa92-9c35-4c9c-8968-27b23383c626', '5a8a6607-8967-4e22-80be-821de0a55de6', '0dc488dd-c884-47f8-bd8b-d67ad6d7611c'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:37 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:51:37 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:38 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.436s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:51:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9a7ffe4d-70dd-4a09-9cfd-c750289fc93d tempest-GroupSnapshotsV319Test-1357468912 None] Delete group completed successfully. Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Acquiring lock "cinder-quobyte-c28102f8-dc06-468a-9dba-354124066460" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Lock "cinder-quobyte-c28102f8-dc06-468a-9dba-354124066460" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e1a5d2-d336-44ce-8619-852f2960df1c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:38 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 Nov 01 08:51:38 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:38 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460" returned: 0 in 0.519s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:38 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460 Nov 01 08:51:38 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:39 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c28102f8-dc06-468a-9dba-354124066460" returned: 0 in 0.336s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Lock "cinder-quobyte-c28102f8-dc06-468a-9dba-354124066460" released by "delete_volume" :: held 0.942s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Created reservations ['a9046840-67e0-41af-929a-933129a6c78e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-71d01e22-39a1-4160-ba20-a217514b4a1d req-5cb7cefd-e720-4f62-9228-e906346c3f6b tempest-TaggedAttachmentsTest-402349138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-71d01e22-39a1-4160-ba20-a217514b4a1d req-5cb7cefd-e720-4f62-9228-e906346c3f6b tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-71d01e22-39a1-4160-ba20-a217514b4a1d req-5cb7cefd-e720-4f62-9228-e906346c3f6b tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:39 devstack cinder-volume[86770]: WARNING cinder.quota [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1081096578 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1081096578, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:51:39 devstack cinder-volume[86770]: WARNING cinder.quota [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1081096578 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1081096578, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-71d01e22-39a1-4160-ba20-a217514b4a1d req-5cb7cefd-e720-4f62-9228-e906346c3f6b tempest-TaggedAttachmentsTest-402349138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-d78dda26-5f90-4406-9b21-2bfad75106e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27235641-2f28-4813-b71a-ee03f7d262a6', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Created reservations ['5d38fa5b-2406-48ef-b413-1b5c7385e908', 'b5f2e29a-ac0f-4192-9497-b769e6c1b49d', '17abcea1-92e0-4771-9c34-7d9c96e73f9f', '888bff2d-5478-4a43-bc33-7a821dafac60'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-71d01e22-39a1-4160-ba20-a217514b4a1d req-5cb7cefd-e720-4f62-9228-e906346c3f6b tempest-TaggedAttachmentsTest-402349138 None] attachment_update completed successfully. Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:39 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:51:39 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:39 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:39 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:51:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-97fd8f7f-81fc-48bd-b77b-1e53d382a2f9 tempest-GroupsTest-121484764 None] Delete group completed successfully. Nov 01 08:51:40 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Created reservations ['017a5053-df01-414d-8ca6-0740731255e0'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:40 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:51:40 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:41 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.297s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:41 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:51:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a6b45c2e-47c8-4128-9cc9-c1bbba352f63 tempest-GroupsTest-121484764 None] Delete group completed successfully. Nov 01 08:51:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a3395efa-2d13-46b5-a2e0-a3836b46af61 tempest-GroupsTest-121484764 None] Group tempest-GroupsTest-Group-422885284: creating Nov 01 08:51:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a3395efa-2d13-46b5-a2e0-a3836b46af61 tempest-GroupsTest-121484764 None] Group tempest-GroupsTest-Group-422885284: created successfully Nov 01 08:51:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a3395efa-2d13-46b5-a2e0-a3836b46af61 tempest-GroupsTest-121484764 None] Create group completed successfully. Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Flow 'volume_create_manager' (2ac0747f-aa52-4773-9279-e8006e45ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf5bed4-cbd6-4f1c-af50-6d0ba99989f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf5bed4-cbd6-4f1c-af50-6d0ba99989f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2122443435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d3ce90-607e-426e-955a-007b3591aba2,host='devstack@QuobyteHD#QuobyteHD',id=5ba7080c-34af-4684-8f84-872646a54e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bed2e46da84a639129fadc541f841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:44Z,use_quota=True,user_id='7f45db3a95584966860cbd87ba775c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ff3353-8b38-47f0-a74c-c4d7b55c779d),volume_type_id=37ff3353-8b38-47f0-a74c-c4d7b55c779d)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209c51fb-f733-42da-9386-241d1a637bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209c51fb-f733-42da-9386-241d1a637bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e3f241-b465-49ba-99a6-4d7f8021f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e3f241-b465-49ba-99a6-4d7f8021f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba7080c-34af-4684-8f84-872646a54e45', 'volume_name': 'volume-5ba7080c-34af-4684-8f84-872646a54e45', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef2816c-6272-4961-b012-3e4fe0884cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef2816c-6272-4961-b012-3e4fe0884cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf750bf-da18-4848-8465-72de61ce878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:44 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Volume 5ba7080c-34af-4684-8f84-872646a54e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba7080c-34af-4684-8f84-872646a54e45', 'volume_size': 1} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23d3ce90-607e-426e-955a-007b3591aba2,created_at=2026-11-01T07:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2122443435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d3ce90-607e-426e-955a-007b3591aba2,host='devstack@QuobyteHD#QuobyteHD',id=5ba7080c-34af-4684-8f84-872646a54e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bed2e46da84a639129fadc541f841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:44Z,use_quota=True,user_id='7f45db3a95584966860cbd87ba775c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ff3353-8b38-47f0-a74c-c4d7b55c779d),volume_type_id=37ff3353-8b38-47f0-a74c-c4d7b55c779d)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Creating volume 5ba7080c-34af-4684-8f84-872646a54e45 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:51:44 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:44 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 1073741824 Nov 01 08:51:44 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-2e2fd05c-46b2-4261-8e01-0c5c43fe8da3 req-b03010bc-fa80-493c-80c4-dbec4d216cd6 tempest-TaggedAttachmentsTest-402349138 None] Terminate volume connection completed successfully. Nov 01 08:51:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2e2fd05c-46b2-4261-8e01-0c5c43fe8da3 req-b03010bc-fa80-493c-80c4-dbec4d216cd6 tempest-TaggedAttachmentsTest-402349138 None] Deleting attachment 27235641-2f28-4813-b71a-ee03f7d262a6. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:51:45 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 1073741824" returned: 0 in 0.784s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:45 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 Nov 01 08:51:45 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:46 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45" returned: 0 in 0.668s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:51:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf750bf-da18-4848-8465-72de61ce878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba7080c-34af-4684-8f84-872646a54e45', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f4f9d1-25cd-4b6f-a448-2ad012746ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:46 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Volume volume-5ba7080c-34af-4684-8f84-872646a54e45 (5ba7080c-34af-4684-8f84-872646a54e45): created successfully Nov 01 08:51:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f4f9d1-25cd-4b6f-a448-2ad012746ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Flow 'volume_create_manager' (2ac0747f-aa52-4773-9279-e8006e45ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9f8c7333-f12d-479d-ac61-4e09033d14ad tempest-GroupsTest-121484764 None] Created volume successfully. Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Flow 'volume_create_manager' (aaec1b2b-3272-4221-9f3e-07592cdb7386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c30490-57bd-4b23-aabf-53032fe2ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c30490-57bd-4b23-aabf-53032fe2ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612228574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d3ce90-607e-426e-955a-007b3591aba2,host='devstack@QuobyteHD#QuobyteHD',id=40f8e8ec-d98c-4682-9354-d9523be91b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bed2e46da84a639129fadc541f841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:48Z,use_quota=True,user_id='7f45db3a95584966860cbd87ba775c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ff3353-8b38-47f0-a74c-c4d7b55c779d),volume_type_id=37ff3353-8b38-47f0-a74c-c4d7b55c779d)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a93451-604b-43d2-a6d6-f01ebdc16709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a93451-604b-43d2-a6d6-f01ebdc16709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24218dd8-d3b0-4029-a5bd-7db53188eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24218dd8-d3b0-4029-a5bd-7db53188eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f8e8ec-d98c-4682-9354-d9523be91b79', 'volume_name': 'volume-40f8e8ec-d98c-4682-9354-d9523be91b79', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbace5ce-5308-4bba-9df0-a6766816d8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbace5ce-5308-4bba-9df0-a6766816d8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9e8dbf-50ff-48c6-a14e-b27c52571f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:48 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Volume 40f8e8ec-d98c-4682-9354-d9523be91b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f8e8ec-d98c-4682-9354-d9523be91b79', 'volume_size': 1} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23d3ce90-607e-426e-955a-007b3591aba2,created_at=2026-11-01T07:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612228574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23d3ce90-607e-426e-955a-007b3591aba2,host='devstack@QuobyteHD#QuobyteHD',id=40f8e8ec-d98c-4682-9354-d9523be91b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bed2e46da84a639129fadc541f841f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:48Z,use_quota=True,user_id='7f45db3a95584966860cbd87ba775c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37ff3353-8b38-47f0-a74c-c4d7b55c779d),volume_type_id=37ff3353-8b38-47f0-a74c-c4d7b55c779d)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Creating volume 40f8e8ec-d98c-4682-9354-d9523be91b79 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:51:48 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:48 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 1073741824 Nov 01 08:51:48 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:48 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 1073741824" returned: 0 in 0.698s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:49 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 Nov 01 08:51:49 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:49 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79" returned: 0 in 0.455s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:51:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9e8dbf-50ff-48c6-a14e-b27c52571f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f8e8ec-d98c-4682-9354-d9523be91b79', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7a1043-71e5-4549-b36a-8c8ca5cb6a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Volume volume-40f8e8ec-d98c-4682-9354-d9523be91b79 (40f8e8ec-d98c-4682-9354-d9523be91b79): created successfully Nov 01 08:51:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7a1043-71e5-4549-b36a-8c8ca5cb6a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Flow 'volume_create_manager' (aaec1b2b-3272-4221-9f3e-07592cdb7386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ca535940-fd44-4569-90ba-8b9858e5386b tempest-GroupsTest-121484764 None] Created volume successfully. Nov 01 08:51:50 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-12dd703f-50e5-4d21-b69d-b02e145c725e tempest-GroupsTest-121484764 None] Update group completed successfully. Nov 01 08:51:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-65f0576b-dfc1-42e6-99b4-bb7858ce9b94 tempest-GroupsTest-121484764 None] Update group completed successfully. Nov 01 08:51:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Acquiring lock "cinder-quobyte-40f8e8ec-d98c-4682-9354-d9523be91b79" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Lock "cinder-quobyte-40f8e8ec-d98c-4682-9354-d9523be91b79" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d5d369-3ba2-4b35-be4a-68fc7bce9a17]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:55 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 Nov 01 08:51:55 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:55 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79" returned: 0 in 0.543s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:55 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79 Nov 01 08:51:55 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:55 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-40f8e8ec-d98c-4682-9354-d9523be91b79" returned: 0 in 0.341s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Lock "cinder-quobyte-40f8e8ec-d98c-4682-9354-d9523be91b79" released by "delete_volume" :: held 0.953s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Acquiring lock "cinder-quobyte-5ba7080c-34af-4684-8f84-872646a54e45" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:51:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Lock "cinder-quobyte-5ba7080c-34af-4684-8f84-872646a54e45" acquired by "delete_volume" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:51:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591c588-a76c-4e7e-a0fb-66e3c6fd2a87]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:51:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:56 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 Nov 01 08:51:56 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:56 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45" returned: 0 in 0.658s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:56 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45 Nov 01 08:51:56 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:57 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3a834db1-6e4f-45ba-b635-f7eef5ce9733 tempest-GroupsV314Test-372870119 None] Group tempest-GroupsV314Test-Group-1275076833: creating Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5ba7080c-34af-4684-8f84-872646a54e45" returned: 0 in 0.465s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Lock "cinder-quobyte-5ba7080c-34af-4684-8f84-872646a54e45" released by "delete_volume" :: held 1.191s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:51:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3a834db1-6e4f-45ba-b635-f7eef5ce9733 tempest-GroupsV314Test-372870119 None] Group tempest-GroupsV314Test-Group-1275076833: created successfully Nov 01 08:51:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3a834db1-6e4f-45ba-b635-f7eef5ce9733 tempest-GroupsV314Test-372870119 None] Create group completed successfully. Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Created reservations ['d93d9780-4b50-4780-9593-514c5a45e2b0'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:57 devstack cinder-volume[86770]: WARNING cinder.quota [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1638966095 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1638966095, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:51:57 devstack cinder-volume[86770]: WARNING cinder.quota [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1638966095 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1638966095, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Created reservations ['22d2759d-9aab-4966-b973-fdf2cd64f301', '4f8c61e1-afdf-4301-b3bb-949be648ab28', 'da2fe21b-304a-47c7-890b-12a2d3247ca4', '29caf076-3c86-4cd2-94a7-956b0f417610'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Created reservations ['9b6ecb2d-d42b-46b4-ac0a-9e42aa1e819f', '0f225a8e-c5b4-4bd4-896b-de6dd2ce9a16', '2b68668f-dbdb-47a1-a990-bd270247a51d', 'bc9fa1e5-fb5e-4ea9-b8ad-5877ce940f8c'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:57 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:51:57 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:51:57 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:51:57 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:51:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-34569e9c-97e5-46e3-a966-9e4ef3d2eea2 tempest-GroupsTest-121484764 None] Delete group completed successfully. Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Flow 'volume_create_manager' (37a2d641-e89d-4317-9ff2-313086ca7082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7224502d-d5fa-4fd2-b873-ce77dc15412e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7224502d-d5fa-4fd2-b873-ce77dc15412e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1699569590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c6c6a09-8bae-4357-ac0c-6b6f8e9af2c1,host='devstack@QuobyteHD#QuobyteHD',id=1e31100c-3f7e-470f-bfdc-57e2b0b4f8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aba9952f134e94918491c1ab1f8c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:59Z,use_quota=True,user_id='72413c18fbe04c51b25b90103e768788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06a3f1d1-918a-4076-9682-c89dcebcf798),volume_type_id=06a3f1d1-918a-4076-9682-c89dcebcf798)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6762a85e-c323-4a5f-a10e-c63fbbbd379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6762a85e-c323-4a5f-a10e-c63fbbbd379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6310e4d0-280c-4c89-96f9-1c87f6dfbadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6310e4d0-280c-4c89-96f9-1c87f6dfbadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e31100c-3f7e-470f-bfdc-57e2b0b4f8df', 'volume_name': 'volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba1903a-7da8-4b9b-8a11-f87b18136995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba1903a-7da8-4b9b-8a11-f87b18136995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06047c1-fae8-45e8-9690-6d728fa8cd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:51:59 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Volume 1e31100c-3f7e-470f-bfdc-57e2b0b4f8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df', 'volume_size': 1} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c6c6a09-8bae-4357-ac0c-6b6f8e9af2c1,created_at=2026-11-01T07:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1699569590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c6c6a09-8bae-4357-ac0c-6b6f8e9af2c1,host='devstack@QuobyteHD#QuobyteHD',id=1e31100c-3f7e-470f-bfdc-57e2b0b4f8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aba9952f134e94918491c1ab1f8c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:51:59Z,use_quota=True,user_id='72413c18fbe04c51b25b90103e768788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06a3f1d1-918a-4076-9682-c89dcebcf798),volume_type_id=06a3f1d1-918a-4076-9682-c89dcebcf798)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Creating volume 1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:51:59 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:51:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:51:59 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df 1073741824 Nov 01 08:51:59 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:00 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df 1073741824" returned: 0 in 0.768s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:00 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df Nov 01 08:52:00 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:00 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" returned: 0 in 0.434s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06047c1-fae8-45e8-9690-6d728fa8cd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5bb938-366d-4e28-8025-2d8688077ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Volume volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df (1e31100c-3f7e-470f-bfdc-57e2b0b4f8df): created successfully Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5bb938-366d-4e28-8025-2d8688077ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Flow 'volume_create_manager' (37a2d641-e89d-4317-9ff2-313086ca7082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:52:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5308abe5-f501-40f6-9167-c1f96fa5ada1 tempest-GroupsV314Test-372870119 None] Created volume successfully. Nov 01 08:52:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Acquiring lock "cinder-d78dda26-5f90-4406-9b21-2bfad75106e9-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Lock "cinder-d78dda26-5f90-4406-9b21-2bfad75106e9-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Acquiring lock "cinder-quobyte-d78dda26-5f90-4406-9b21-2bfad75106e9" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Lock "cinder-quobyte-d78dda26-5f90-4406-9b21-2bfad75106e9" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:02 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab63fff-0207-408a-a03f-5167577445c0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:02 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 Nov 01 08:52:02 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Flow 'volume_create_manager' (3f2f2dbb-5f4d-4fa1-b5f2-8006e072adf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266b3ed0-ed13-48ab-86e7-8f3f175de036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:03 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266b3ed0-ed13-48ab-86e7-8f3f175de036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-87259898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83c4b21-8cb0-4a88-991b-44c6f56e220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db14e292728415fb652fff50e81cdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:52:03Z,use_quota=True,user_id='35a08df2be19452b832e0de2448e1754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01037d7d-f37b-4f06-899c-65f80917662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01037d7d-f37b-4f06-899c-65f80917662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d042c3b-46f7-4869-9d33-e89cb9780b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d042c3b-46f7-4869-9d33-e89cb9780b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83c4b21-8cb0-4a88-991b-44c6f56e220a', 'volume_name': 'volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f78f771-d4be-4532-8858-53f422f83be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f78f771-d4be-4532-8858-53f422f83be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8384ee29-c542-492b-9f43-c8e2390c0fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:03 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Volume b83c4b21-8cb0-4a88-991b-44c6f56e220a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a', 'volume_size': 1} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-87259898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83c4b21-8cb0-4a88-991b-44c6f56e220a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db14e292728415fb652fff50e81cdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:52:03Z,use_quota=True,user_id='35a08df2be19452b832e0de2448e1754',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Creating volume b83c4b21-8cb0-4a88-991b-44c6f56e220a {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:52:03 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:03 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a 1073741824 Nov 01 08:52:03 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9" returned: 0 in 0.890s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:03 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9 Nov 01 08:52:03 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:03 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d78dda26-5f90-4406-9b21-2bfad75106e9" returned: 0 in 0.425s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Lock "cinder-quobyte-d78dda26-5f90-4406-9b21-2bfad75106e9" released by "delete_volume" :: held 1.400s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Created reservations ['77768d8f-6afd-457c-a92c-b3a044fbe792', 'c6761640-f639-411d-8dd2-a5669168fc1b', '2950c38a-0ace-4414-85d0-3a12478d54dc', 'b427f9b0-383c-4de9-8650-f45011eca45b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:03 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:52:03 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:04 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a 1073741824" returned: 0 in 0.913s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:04 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a Nov 01 08:52:04 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:04 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.516s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:52:04 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Deleted volume successfully. Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d29a0ff9-d171-4e51-9093-bb7a7ee8f44f tempest-TaggedAttachmentsTest-402349138 None] Lock "cinder-d78dda26-5f90-4406-9b21-2bfad75106e9-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:04 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a" returned: 0 in 0.331s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.181s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:04 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Cloning volume 1e31100c-3f7e-470f-bfdc-57e2b0b4f8df to volume e233dfa0-16ff-48b4-97c2-0743851f7186 Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8384ee29-c542-492b-9f43-c8e2390c0fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196006b3-cad5-47e8-8f9d-6b445cab6321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Creating offline snapshot 2b8e28d5-dfdc-4099-9073-c2274734b191 of volume 1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:52:04 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Volume volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a (b83c4b21-8cb0-4a88-991b-44c6f56e220a): created successfully Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196006b3-cad5-47e8-8f9d-6b445cab6321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Flow 'volume_create_manager' (3f2f2dbb-5f4d-4fa1-b5f2-8006e072adf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c205581-017d-4c1e-b382-85671af816ea]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:04 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3ba236ca-4edf-49e8-b746-70ac3b2d6ab3 tempest-VolumesAdminNegativeTest-1417900559 None] Created volume successfully. Nov 01 08:52:04 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df Nov 01 08:52:04 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:05 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" returned: 0 in 0.724s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:05 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 1G Nov 01 08:52:05 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Acquiring lock "cinder-b83c4b21-8cb0-4a88-991b-44c6f56e220a-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Lock "cinder-b83c4b21-8cb0-4a88-991b-44c6f56e220a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Acquiring lock "cinder-quobyte-b83c4b21-8cb0-4a88-991b-44c6f56e220a" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Lock "cinder-quobyte-b83c4b21-8cb0-4a88-991b-44c6f56e220a" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:06 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 1G" returned: 0 in 0.778s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce0c25-b2dd-4657-ae91-79f02f6557e3]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:06 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 Nov 01 08:52:06 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:06 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a Nov 01 08:52:06 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:06 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191" returned: 0 in 0.533s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:06 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:06 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 Nov 01 08:52:06 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:06 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a" returned: 0 in 0.624s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:06 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a Nov 01 08:52:06 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:07 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191" returned: 0 in 0.358s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:07 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.info Nov 01 08:52:07 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:07 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b83c4b21-8cb0-4a88-991b-44c6f56e220a" returned: 0 in 0.370s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Lock "cinder-quobyte-b83c4b21-8cb0-4a88-991b-44c6f56e220a" released by "delete_volume" :: held 1.064s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Created reservations ['f5e8c6c3-81cd-46cf-83aa-fd4f2962a67e', '233eb159-9284-4ab3-acb0-c006804abcad', '3c3de4c3-9936-4cdf-a7aa-9fe03c5aff5e', '920646b0-b50d-4438-88f6-e5f4b44e3ec6'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:07 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:52:07 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:07 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.info" returned: 0 in 0.536s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:07 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:07 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.info Nov 01 08:52:07 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:07 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.352s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:52:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Deleted volume successfully. Nov 01 08:52:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1103c4c-88d7-4b8e-a613-b17e5bb4ed0e tempest-VolumesAdminNegativeTest-1417900559 None] Lock "cinder-b83c4b21-8cb0-4a88-991b-44c6f56e220a-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:08 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.info" returned: 0 in 0.387s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Acquiring lock "cinder-quobyte-e233dfa0-16ff-48b4-97c2-0743851f7186" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-e233dfa0-16ff-48b4-97c2-0743851f7186" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] snapshot: 2b8e28d5-dfdc-4099-9073-c2274734b191, volume: e233dfa0-16ff-48b4-97c2-0743851f7186, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e174f7-f1d9-4c88-8f5f-916fac316649]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:08 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 Nov 01 08:52:08 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:08 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191" returned: 0 in 0.479s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9353c31b-7980-4136-8db2-3bf7973b03a1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:08 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df Nov 01 08:52:08 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:09 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" returned: 0 in 0.872s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 08:52:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 08:52:09 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 08:52:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:09 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 Nov 01 08:52:09 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-82f0e083-32af-45e1-88fa-d01494256703 tempest-GroupsV320Test-1123490023 None] Group tempest-GroupsV320Test-Group-877942036: creating Nov 01 08:52:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-82f0e083-32af-45e1-88fa-d01494256703 tempest-GroupsV320Test-1123490023 None] Group tempest-GroupsV320Test-Group-877942036: created successfully Nov 01 08:52:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-82f0e083-32af-45e1-88fa-d01494256703 tempest-GroupsV320Test-1123490023 None] Create group completed successfully. Nov 01 08:52:11 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Created reservations ['acee6ba0-2cd2-45df-8430-8a18ebb3ef31'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:12 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:52:12 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:12 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.707s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:12 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:52:12 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e1dbe6f0-a81d-4e10-8597-6262b13a7b01 tempest-GroupsV320Test-1123490023 None] Delete group completed successfully. Nov 01 08:52:18 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186" returned: 0 in 8.994s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:52:18 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Converted 1024.00 MB image at 113.83 MB/s Nov 01 08:52:18 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:18 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 Nov 01 08:52:18 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:18 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186" returned: 0 in 0.253s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-e233dfa0-16ff-48b4-97c2-0743851f7186" released by "_copy_volume_from_snapshot" :: held 10.713s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=107,cinder:UPDATE=88,cinder:DELETE=3,cinder:INSERT=15 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Acquiring lock "cinder-quobyte-2b8e28d5-dfdc-4099-9073-c2274734b191" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-2b8e28d5-dfdc-4099-9073-c2274734b191" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Deleting offline snapshot 2b8e28d5-dfdc-4099-9073-c2274734b191 of volume 1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] snapshot_file for this snap is: volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[55986666-0cbd-445a-b29c-b209afb9f8f4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:18 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 Nov 01 08:52:18 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:19 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:52:19 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[279e10cc-2a45-4284-b57f-536ce85602b0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:19 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df Nov 01 08:52:19 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:19 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" returned: 0 in 0.697s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:19 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 Nov 01 08:52:19 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:20 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191" returned: 0 in 0.466s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:20 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191 Nov 01 08:52:20 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:20 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df.2b8e28d5-dfdc-4099-9073-c2274734b191" returned: 0 in 0.302s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-2b8e28d5-dfdc-4099-9073-c2274734b191" released by "_delete_snapshot" :: held 1.940s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:20 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=109,cinder:SELECT=95,cinder:INSERT=27,cinder:DELETE=5 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:52:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.256s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-81730cca-0304-4f63-8980-37811346b0a8 tempest-GroupsV314Test-372870119 None] Create group from source-group-7c6c6a09-8bae-4357-ac0c-6b6f8e9af2c1 completed successfully. Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:21 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:52:21 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:21 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.381s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Acquiring lock "cinder-quobyte-e233dfa0-16ff-48b4-97c2-0743851f7186" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-e233dfa0-16ff-48b4-97c2-0743851f7186" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[083924b1-96f7-475f-8a0e-c720c17ae009]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:21 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 Nov 01 08:52:21 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:22 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186" returned: 0 in 0.490s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:22 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186 Nov 01 08:52:22 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:22 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e233dfa0-16ff-48b4-97c2-0743851f7186" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-e233dfa0-16ff-48b4-97c2-0743851f7186" released by "delete_volume" :: held 0.931s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Created reservations ['e1a127ce-13fd-48be-bfc8-891f517f2639'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:22 devstack cinder-volume[86770]: WARNING cinder.quota [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1752399029 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1752399029, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:52:22 devstack cinder-volume[86770]: WARNING cinder.quota [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1752399029 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1752399029, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Created reservations ['06b86f16-e39c-4324-88c5-f2d88198713d', '2f95bdc7-cb85-43e2-9b8a-df74521b3f70', '782b8482-a823-40b1-a335-a920ec2329e4', 'ec8899db-7276-4d48-a4b0-3d2c9614692d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:23 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:52:23 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:23 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.272s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:23 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:52:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-65af6a87-561c-48ab-9646-30a1ddaeeee9 tempest-GroupsV314Test-372870119 None] Delete group completed successfully. Nov 01 08:52:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Acquiring lock "cinder-quobyte-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:24 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a9312-946e-442b-81fe-0fe98f7b17f6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:24 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df Nov 01 08:52:24 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:24 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" returned: 0 in 0.497s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:25 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df Nov 01 08:52:25 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:25 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" returned: 0 in 0.277s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Lock "cinder-quobyte-1e31100c-3f7e-470f-bfdc-57e2b0b4f8df" released by "delete_volume" :: held 0.892s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Created reservations ['a08b6134-8b27-4c84-bee8-42568035a5fc'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Created reservations ['1ef616f6-d0ca-4ba0-8c7b-76ea0a9158e7', 'e3ff3a48-75fe-48e6-b915-b1b67ea42d1e', '1af95906-be15-44ef-be3d-35670e506011', '934de8b9-0259-47ed-9738-4f01b4c143bf'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:25 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:52:25 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:25 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.367s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:25 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:52:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b50fb951-85e3-49f7-87f7-c897deece2b3 tempest-GroupsV314Test-372870119 None] Delete group completed successfully. Nov 01 08:52:35 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=20,cinder:SELECT=19,cinder:INSERT=6 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:52:35 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=27,cinder:SELECT=17,cinder:INSERT=4 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Flow 'volume_create_manager' (63d93736-06e5-4c35-84a7-bed498da73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44001e0-4a31-4c34-9a16-594dbd976771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44001e0-4a31-4c34-9a16-594dbd976771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-537044585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ddc2ae-b2b1-4649-8341-3bfd71edf96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362c1cdfd8cf422e9a7f9499d7973641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:52:38Z,use_quota=True,user_id='a52f16521753463d9e7b8aa60025c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bca3fac-b4fc-4e4a-b784-655812afd684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bca3fac-b4fc-4e4a-b784-655812afd684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9e195e-0f18-486b-a8e7-5be58f516d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9e195e-0f18-486b-a8e7-5be58f516d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ddc2ae-b2b1-4649-8341-3bfd71edf96a', 'volume_name': 'volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6ff021-6ae3-44a7-baba-e3e4faa999c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6ff021-6ae3-44a7-baba-e3e4faa999c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34acad29-58d0-4ba4-8c8c-ca5bee2969cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:38 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Volume 69ddc2ae-b2b1-4649-8341-3bfd71edf96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a', 'volume_size': 1} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-537044585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ddc2ae-b2b1-4649-8341-3bfd71edf96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362c1cdfd8cf422e9a7f9499d7973641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:52:38Z,use_quota=True,user_id='a52f16521753463d9e7b8aa60025c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Creating volume 69ddc2ae-b2b1-4649-8341-3bfd71edf96a {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:52:38 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:52:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:38 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a 1073741824 Nov 01 08:52:38 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:39 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a 1073741824" returned: 0 in 0.560s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:39 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a Nov 01 08:52:39 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:39 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a" returned: 0 in 0.351s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34acad29-58d0-4ba4-8c8c-ca5bee2969cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca540ec-02bd-461d-8f57-67803b938997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:39 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Volume volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a (69ddc2ae-b2b1-4649-8341-3bfd71edf96a): created successfully Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca540ec-02bd-461d-8f57-67803b938997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Flow 'volume_create_manager' (63d93736-06e5-4c35-84a7-bed498da73fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:52:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1c937a65-2415-448f-9c4b-38b1ce5ce4a4 tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Created volume successfully. Nov 01 08:52:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Acquiring lock "cinder-69ddc2ae-b2b1-4649-8341-3bfd71edf96a-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "cinder-69ddc2ae-b2b1-4649-8341-3bfd71edf96a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Acquiring lock "cinder-quobyte-69ddc2ae-b2b1-4649-8341-3bfd71edf96a" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:52:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "cinder-quobyte-69ddc2ae-b2b1-4649-8341-3bfd71edf96a" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:52:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dc1fd0-41e3-4431-ae7d-d287c77445d0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:52:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:43 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a Nov 01 08:52:43 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:43 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a" returned: 0 in 0.558s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:43 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a Nov 01 08:52:43 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:43 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-69ddc2ae-b2b1-4649-8341-3bfd71edf96a" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "cinder-quobyte-69ddc2ae-b2b1-4649-8341-3bfd71edf96a" released by "delete_volume" :: held 1.092s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Created reservations ['789f8254-17d1-4091-9b03-545da58bec4f', 'e4b48440-2076-4860-a6bb-333ea17ca2ce', '6406ed06-c571-40d5-83c9-b2914fc4422c', 'dd880628-875c-4442-aaba-71e20b5f0112'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:44 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:52:44 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:44 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.337s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:52:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Deleted volume successfully. Nov 01 08:52:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-08ac5669-9a56-4179-b49a-411400c7155f tempest-VolumeQuotasNegativeTestJSON-1587786511 None] Lock "cinder-69ddc2ae-b2b1-4649-8341-3bfd71edf96a-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:52:54 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:52:54 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=15,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Flow 'volume_create_manager' (9edeff4d-7cec-42f5-8c63-1aa12293e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5364a4-d1b5-4a32-8efc-919a4e19d295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5364a4-d1b5-4a32-8efc-919a4e19d295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1635642594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093984d9-2054-4bbb-8342-599a4f57b1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0179fb067b4554af62f976a3d35536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:52:58Z,use_quota=True,user_id='1814382d4ef946da8a262c77ec288e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4f1473-7bdc-462a-bda7-ba964d47671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4f1473-7bdc-462a-bda7-ba964d47671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebdc536-27f4-4e6f-89c0-ebc9cbe91dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebdc536-27f4-4e6f-89c0-ebc9cbe91dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093984d9-2054-4bbb-8342-599a4f57b1de', 'volume_name': 'volume-093984d9-2054-4bbb-8342-599a4f57b1de', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b115f04-6256-41d3-9131-42df07b3858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b115f04-6256-41d3-9131-42df07b3858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283638b1-482e-4277-8771-0ec8a55257cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:52:58 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Volume 093984d9-2054-4bbb-8342-599a4f57b1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093984d9-2054-4bbb-8342-599a4f57b1de', 'volume_size': 1} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1635642594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093984d9-2054-4bbb-8342-599a4f57b1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0179fb067b4554af62f976a3d35536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:52:58Z,use_quota=True,user_id='1814382d4ef946da8a262c77ec288e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Creating volume 093984d9-2054-4bbb-8342-599a4f57b1de {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:52:58 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:52:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:58 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de 1073741824 Nov 01 08:52:58 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:52:59 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Nov 01 08:52:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de 1073741824" returned: 0 in 1.266s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:52:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:52:59 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de Nov 01 08:52:59 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:00 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de" returned: 0 in 0.642s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283638b1-482e-4277-8771-0ec8a55257cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093984d9-2054-4bbb-8342-599a4f57b1de', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7498e52e-dd64-4a98-a81f-0ac63228b3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Volume volume-093984d9-2054-4bbb-8342-599a4f57b1de (093984d9-2054-4bbb-8342-599a4f57b1de): created successfully Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7498e52e-dd64-4a98-a81f-0ac63228b3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Flow 'volume_create_manager' (9edeff4d-7cec-42f5-8c63-1aa12293e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9d875dd1-94be-4b71-a7f0-efc8aec9d380 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Created volume successfully. Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Flow 'volume_create_manager' (02482edc-774a-4428-8977-e29a755f87b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6e8bbc-b76f-4b97-824f-c66a025c6f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6e8bbc-b76f-4b97-824f-c66a025c6f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-883629063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9db542c0e674a3188cd32748c874b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:01Z,use_quota=True,user_id='6eb09a4e38c548d1a4766ef436ffd86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80d43516-0f0d-42bc-a381-ed0ee4800516),volume_type_id=80d43516-0f0d-42bc-a381-ed0ee4800516)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e80aae-1941-4ff1-a85b-ab7a39f7b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24e80aae-1941-4ff1-a85b-ab7a39f7b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb4d620-904b-4140-972f-e5899fa8361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb4d620-904b-4140-972f-e5899fa8361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8', 'volume_name': 'volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e09893-5e1d-49a2-b9e4-4e317d876f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e09893-5e1d-49a2-b9e4-4e317d876f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ebf89a-aa3d-4175-bc2b-4cc606f80813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:01 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Volume bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8', 'volume_size': 1} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-883629063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9db542c0e674a3188cd32748c874b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:01Z,use_quota=True,user_id='6eb09a4e38c548d1a4766ef436ffd86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80d43516-0f0d-42bc-a381-ed0ee4800516),volume_type_id=80d43516-0f0d-42bc-a381-ed0ee4800516)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Creating volume bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:01 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:01 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 1073741824 Nov 01 08:53:01 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Acquiring lock "cinder-093984d9-2054-4bbb-8342-599a4f57b1de-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:01 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 1073741824" returned: 0 in 0.969s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "cinder-093984d9-2054-4bbb-8342-599a4f57b1de-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Acquiring lock "cinder-quobyte-093984d9-2054-4bbb-8342-599a4f57b1de" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:02 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 Nov 01 08:53:02 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "cinder-quobyte-093984d9-2054-4bbb-8342-599a4f57b1de" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f227ae-3b25-46c4-a3eb-7c3ecaf3e25c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:02 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de Nov 01 08:53:02 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:02 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8" returned: 0 in 0.410s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ebf89a-aa3d-4175-bc2b-4cc606f80813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa41f86b-431f-4f29-99a0-eeb27235a3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:02 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Volume volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 (bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8): created successfully Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa41f86b-431f-4f29-99a0-eeb27235a3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Flow 'volume_create_manager' (02482edc-774a-4428-8977-e29a755f87b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:02 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de" returned: 0 in 0.479s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2d0adc0d-d2d1-439b-a110-0d564f68373f tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Created volume successfully. Nov 01 08:53:02 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de Nov 01 08:53:02 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:03 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-093984d9-2054-4bbb-8342-599a4f57b1de" returned: 0 in 0.421s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "cinder-quobyte-093984d9-2054-4bbb-8342-599a4f57b1de" released by "delete_volume" :: held 0.999s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Created reservations ['cd38b6ec-6fa4-418a-b99f-58805e91f9bb', '688d40fa-891c-49bd-893f-c062cbd65c97', 'a11f0055-79a1-43ed-9b44-59cf59947460', '22aa1063-4ca2-4bd3-a2f7-c488f4fae56b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:03 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:03 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:03 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Deleted volume successfully. Nov 01 08:53:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-af914aa1-9f84-4e57-a037-f42f7bc02724 tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "cinder-093984d9-2054-4bbb-8342-599a4f57b1de-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:05 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:05 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:05 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.574s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:05 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ec75c8c5-7bff-4e3d-bb67-15c98f1ccc62 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Retype volume completed successfully. Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Flow 'volume_create_manager' (750a3a51-899e-4059-8a4e-b2065946dd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c894c40-ea12-4e8f-b60f-9a046ae08a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c894c40-ea12-4e8f-b60f-9a046ae08a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1346419481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d17acb-c070-4a0b-b38e-afc7ff627d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0179fb067b4554af62f976a3d35536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:06Z,use_quota=True,user_id='1814382d4ef946da8a262c77ec288e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdf77bd-f5e1-4157-b609-960760ee81e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdf77bd-f5e1-4157-b609-960760ee81e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38391727-e33d-461c-a2a5-e513e251ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38391727-e33d-461c-a2a5-e513e251ef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d17acb-c070-4a0b-b38e-afc7ff627d99', 'volume_name': 'volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c684097-fe7b-4e69-bca3-5b6854aea100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c684097-fe7b-4e69-bca3-5b6854aea100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c7761d-b510-4b8f-93e1-9ddd77173de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:06 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Volume b7d17acb-c070-4a0b-b38e-afc7ff627d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99', 'volume_size': 1} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1346419481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d17acb-c070-4a0b-b38e-afc7ff627d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0179fb067b4554af62f976a3d35536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:06Z,use_quota=True,user_id='1814382d4ef946da8a262c77ec288e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Creating volume b7d17acb-c070-4a0b-b38e-afc7ff627d99 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:06 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:06 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 1073741824 Nov 01 08:53:06 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Acquiring lock "cinder-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "cinder-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Acquiring lock "cinder-quobyte-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "cinder-quobyte-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac5fd6b-7eee-491c-ad10-a68f41f88f68]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:07 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 Nov 01 08:53:07 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:07 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 1073741824" returned: 0 in 1.026s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:07 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 Nov 01 08:53:07 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:07 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8" returned: 0 in 0.794s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:07 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8 Nov 01 08:53:07 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:07 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Flow 'volume_create_manager' (1d127cf5-2060-49e4-b8cc-f2ebad4bd7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641577f8-4c43-4e5c-b974-2aecb117bb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99" returned: 0 in 0.508s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641577f8-4c43-4e5c-b974-2aecb117bb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-861076265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c76db-3a03-41ce-9d91-9503c98d19a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b02ef632885412d9b4969994701d2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:08Z,use_quota=True,user_id='eeea25ec7f184b92ba4822dfe98fe741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1356ebe6-afb2-4785-a363-74ba707fa54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1356ebe6-afb2-4785-a363-74ba707fa54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a195a6-481a-491b-93b5-a3b4842cdfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a195a6-481a-491b-93b5-a3b4842cdfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675c76db-3a03-41ce-9d91-9503c98d19a3', 'volume_name': 'volume-675c76db-3a03-41ce-9d91-9503c98d19a3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04ac16b-8243-46ea-a36a-c5769a278ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04ac16b-8243-46ea-a36a-c5769a278ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d03907-269b-4b8a-9a95-3e7088f386f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:08 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Volume 675c76db-3a03-41ce-9d91-9503c98d19a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675c76db-3a03-41ce-9d91-9503c98d19a3', 'volume_size': 1} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-861076265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c76db-3a03-41ce-9d91-9503c98d19a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b02ef632885412d9b4969994701d2ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:08Z,use_quota=True,user_id='eeea25ec7f184b92ba4822dfe98fe741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Creating volume 675c76db-3a03-41ce-9d91-9503c98d19a3 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:08 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c7761d-b510-4b8f-93e1-9ddd77173de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7ec43e-32d6-40b8-b3d2-6bccdb01793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:08 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 1073741824 Nov 01 08:53:08 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:08 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Volume volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 (b7d17acb-c070-4a0b-b38e-afc7ff627d99): created successfully Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7ec43e-32d6-40b8-b3d2-6bccdb01793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Flow 'volume_create_manager' (750a3a51-899e-4059-8a4e-b2065946dd2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8bf21100-8d5b-4074-baf9-1bcde48cc8bf tempest-VolumeQuotasAdminTestJSON-1406831394 None] Created volume successfully. Nov 01 08:53:08 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8" returned: 0 in 0.451s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "cinder-quobyte-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8" released by "delete_volume" :: held 1.345s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:08 devstack cinder-volume[86770]: WARNING cinder.quota [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:53:08 devstack cinder-volume[86770]: WARNING cinder.quota [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Created reservations ['8f317fa7-2461-4f96-a346-6e5e04d392c2', '0aa77390-81c0-4657-9bf3-7ded91940ccc', '5234bc63-c438-48e4-bc09-cfa473f19779', 'e963ea16-fada-460f-8eaf-331f9698d4d2'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:08 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:08 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:08 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 1073741824" returned: 0 in 0.704s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:08 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.296s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Deleted volume successfully. Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-85986edb-8905-4e7d-8f7a-ef193df3add1 tempest-VolumeRetypeWithoutMigrationTest-1769332797 None] Lock "cinder-bb1bee43-cf29-46d6-a4d0-4952cfdb7ad8-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:08 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 Nov 01 08:53:08 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:09 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d03907-269b-4b8a-9a95-3e7088f386f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675c76db-3a03-41ce-9d91-9503c98d19a3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5168c360-5490-4149-9b45-e79c69d35298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:09 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Volume volume-675c76db-3a03-41ce-9d91-9503c98d19a3 (675c76db-3a03-41ce-9d91-9503c98d19a3): created successfully Nov 01 08:53:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5168c360-5490-4149-9b45-e79c69d35298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Flow 'volume_create_manager' (1d127cf5-2060-49e4-b8cc-f2ebad4bd7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4bd33df6-23ff-4ec0-ab82-87b7e2f42789 tempest-ServerRescueNegativeTestJSON-1795871870 None] Created volume successfully. Nov 01 08:53:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-aa992ce6-8d6e-453a-92c5-34bd32055dff tempest-VolumeQuotasAdminTestJSON-29147393 None] Transfer volume completed successfully. Nov 01 08:53:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Acquiring lock "cinder-b7d17acb-c070-4a0b-b38e-afc7ff627d99-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Lock "cinder-b7d17acb-c070-4a0b-b38e-afc7ff627d99-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Acquiring lock "cinder-quobyte-b7d17acb-c070-4a0b-b38e-afc7ff627d99" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Lock "cinder-quobyte-b7d17acb-c070-4a0b-b38e-afc7ff627d99" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde0a278-64bc-446e-9afa-8512e09f3626]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:11 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 Nov 01 08:53:11 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:11 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99" returned: 0 in 0.523s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:11 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99 Nov 01 08:53:11 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:12 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7d17acb-c070-4a0b-b38e-afc7ff627d99" returned: 0 in 0.459s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Lock "cinder-quobyte-b7d17acb-c070-4a0b-b38e-afc7ff627d99" released by "delete_volume" :: held 1.131s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Created reservations ['a7a4dcf0-6c71-4e34-b06a-6b04a22f312e', 'c71c2a9d-0c38-49e7-b7d8-024f98d383e1', '10bdbc41-f238-4dfd-bf91-084b57d30192', 'a4a90b57-97f1-40f1-99ef-0d4b8010021d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:12 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:12 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:12 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.493s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:12 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Deleted volume successfully. Nov 01 08:53:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-308dc601-b93e-4d8b-b8f3-46d0f9df52a6 tempest-VolumeQuotasAdminTestJSON-78130812 None] Lock "cinder-b7d17acb-c070-4a0b-b38e-afc7ff627d99-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:53:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:21 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:21 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:22 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.815s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:22 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:22 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:53:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 8 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:53:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:53:22 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=31,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:53:22 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=36,cinder:SELECT=30,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Acquiring lock "cinder-675c76db-3a03-41ce-9d91-9503c98d19a3-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "cinder-675c76db-3a03-41ce-9d91-9503c98d19a3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Acquiring lock "cinder-quobyte-675c76db-3a03-41ce-9d91-9503c98d19a3" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "cinder-quobyte-675c76db-3a03-41ce-9d91-9503c98d19a3" acquired by "delete_volume" :: waited 0.043s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cbf998-5ded-436e-a17d-4800271551fd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:25 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 Nov 01 08:53:25 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:25 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3" returned: 0 in 0.577s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:25 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3 Nov 01 08:53:25 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:26 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-675c76db-3a03-41ce-9d91-9503c98d19a3" returned: 0 in 0.750s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "cinder-quobyte-675c76db-3a03-41ce-9d91-9503c98d19a3" released by "delete_volume" :: held 1.453s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Created reservations ['938a7420-d9bd-481e-a171-b01d0049c0d2', '36357338-05d6-45dd-9e84-56eb0b1e2bac', 'ce403a45-c8c3-44e6-8b1c-60ab099fc009', '5c1f458d-d77c-440a-bffd-d78043885620'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:27 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:27 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:27 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.491s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:27 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Deleted volume successfully. Nov 01 08:53:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-72ad423f-0cba-498b-af5b-74ba0172b275 tempest-ServerRescueNegativeTestJSON-1795871870 None] Lock "cinder-675c76db-3a03-41ce-9d91-9503c98d19a3-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:36 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:53:37 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Flow 'volume_create_manager' (8a6ff989-8a3e-4b93-92b0-ba17e08f3192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e2bbd2-a76c-4cf7-be4c-d5f69dfb9e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e2bbd2-a76c-4cf7-be4c-d5f69dfb9e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94032701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d01a242-f6aa-463d-a7f6-83c483235379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ba265324846f18e0745578a11a562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:39Z,use_quota=True,user_id='2e6252ec3b154cddb03d3beefc42a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9b5dbe-4c51-4965-a3dc-5d6c1acbc527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9b5dbe-4c51-4965-a3dc-5d6c1acbc527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bb804b-7647-4fd1-aae8-79c6c045c4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bb804b-7647-4fd1-aae8-79c6c045c4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d01a242-f6aa-463d-a7f6-83c483235379', 'volume_name': 'volume-4d01a242-f6aa-463d-a7f6-83c483235379', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45689c6a-9127-474a-9904-6a2d43e6bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45689c6a-9127-474a-9904-6a2d43e6bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d080130-bf49-44a4-bf93-26eb2f63adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:39 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Volume 4d01a242-f6aa-463d-a7f6-83c483235379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d01a242-f6aa-463d-a7f6-83c483235379', 'volume_size': 1} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94032701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d01a242-f6aa-463d-a7f6-83c483235379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ba265324846f18e0745578a11a562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:39Z,use_quota=True,user_id='2e6252ec3b154cddb03d3beefc42a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Creating volume 4d01a242-f6aa-463d-a7f6-83c483235379 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:39 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:39 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 1073741824 Nov 01 08:53:39 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:40 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 1073741824" returned: 0 in 0.493s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:40 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 Nov 01 08:53:40 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:40 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379" returned: 0 in 0.267s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d080130-bf49-44a4-bf93-26eb2f63adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d01a242-f6aa-463d-a7f6-83c483235379', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fa59e0-9a2d-4609-bcbf-414b2e6a6721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:40 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Volume volume-4d01a242-f6aa-463d-a7f6-83c483235379 (4d01a242-f6aa-463d-a7f6-83c483235379): created successfully Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fa59e0-9a2d-4609-bcbf-414b2e6a6721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Flow 'volume_create_manager' (8a6ff989-8a3e-4b93-92b0-ba17e08f3192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:40 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6b65af0a-eca1-4c99-a030-e2b7719c08ac tempest-VolumesListAdminTestJSON-1516351110 None] Created volume successfully. Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Flow 'volume_create_manager' (5a2b2f6c-60f1-49ec-adf4-7e543d1f29b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb4f276-ff1a-45f0-8c16-8aec305a8d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb4f276-ff1a-45f0-8c16-8aec305a8d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1431869173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fd7d7e-e432-4b2f-87d2-78baca03fab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ba265324846f18e0745578a11a562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:42Z,use_quota=True,user_id='2e6252ec3b154cddb03d3beefc42a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfc1eb1-0c74-4cdc-af69-8b35191689d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfc1eb1-0c74-4cdc-af69-8b35191689d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690053af-1c9c-4034-9371-d8116b13f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690053af-1c9c-4034-9371-d8116b13f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88fd7d7e-e432-4b2f-87d2-78baca03fab4', 'volume_name': 'volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28eee7ca-f35b-4eff-8d4a-b3024feb0673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28eee7ca-f35b-4eff-8d4a-b3024feb0673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a0bd9f-bb6d-41e4-a33d-a785649586f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:42 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Volume 88fd7d7e-e432-4b2f-87d2-78baca03fab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4', 'volume_size': 1} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1431869173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fd7d7e-e432-4b2f-87d2-78baca03fab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ba265324846f18e0745578a11a562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:42Z,use_quota=True,user_id='2e6252ec3b154cddb03d3beefc42a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Creating volume 88fd7d7e-e432-4b2f-87d2-78baca03fab4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:42 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:42 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 1073741824 Nov 01 08:53:42 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:43 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 1073741824" returned: 0 in 0.651s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:43 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 Nov 01 08:53:43 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:43 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4" returned: 0 in 0.311s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a0bd9f-bb6d-41e4-a33d-a785649586f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c231213-148f-4ad5-a6ba-eb87cbf2ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:43 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Volume volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 (88fd7d7e-e432-4b2f-87d2-78baca03fab4): created successfully Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c231213-148f-4ad5-a6ba-eb87cbf2ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Flow 'volume_create_manager' (5a2b2f6c-60f1-49ec-adf4-7e543d1f29b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5f9f5733-45f9-4672-87f3-75c6480b95d4 tempest-VolumesListAdminTestJSON-1516351110 None] Created volume successfully. Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Flow 'volume_create_manager' (b6001b4d-1c43-4a17-8aec-b2aabf051cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7aa58f1-80e3-409d-8b1a-1b1ac49ec2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7aa58f1-80e3-409d-8b1a-1b1ac49ec2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-994500251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a1d27c-7abc-4e4f-83f1-60eaddabf749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ba265324846f18e0745578a11a562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:45Z,use_quota=True,user_id='2e6252ec3b154cddb03d3beefc42a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a179708e-818c-4ee4-b8fc-3fe9efafc88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a179708e-818c-4ee4-b8fc-3fe9efafc88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95d3575-77a1-4f0e-9a7f-deef6bf1ddae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95d3575-77a1-4f0e-9a7f-deef6bf1ddae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a1d27c-7abc-4e4f-83f1-60eaddabf749', 'volume_name': 'volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bd5f49-7ba3-42fb-b8cb-749829c4bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bd5f49-7ba3-42fb-b8cb-749829c4bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4852862c-da55-4b37-b0d9-d70cce4f1ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:45 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Volume b4a1d27c-7abc-4e4f-83f1-60eaddabf749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749', 'volume_size': 1} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-994500251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a1d27c-7abc-4e4f-83f1-60eaddabf749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='026ba265324846f18e0745578a11a562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:45Z,use_quota=True,user_id='2e6252ec3b154cddb03d3beefc42a8be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Creating volume b4a1d27c-7abc-4e4f-83f1-60eaddabf749 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:45 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:45 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 1073741824 Nov 01 08:53:45 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:45 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 1073741824" returned: 0 in 0.603s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:45 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 Nov 01 08:53:45 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:46 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749" returned: 0 in 0.441s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4852862c-da55-4b37-b0d9-d70cce4f1ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20143ba3-deea-4ba8-a49f-d6f494f9735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:46 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Volume volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 (b4a1d27c-7abc-4e4f-83f1-60eaddabf749): created successfully Nov 01 08:53:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20143ba3-deea-4ba8-a49f-d6f494f9735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Flow 'volume_create_manager' (b6001b4d-1c43-4a17-8aec-b2aabf051cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-65fce95f-80cb-4dd9-bc11-014635fd8a6a tempest-VolumesListAdminTestJSON-1516351110 None] Created volume successfully. Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Flow 'volume_create_manager' (075855cc-2ba4-465e-b464-132ffdf0da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea232351-497e-4889-a16c-f35fc4645cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea232351-497e-4889-a16c-f35fc4645cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91ae828-b0cf-4d3d-976d-a0decbd5471c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d580a4d9644f4c61b3e67657fc7e20af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:48Z,use_quota=True,user_id='58e5746d35ba4aea9957e0c36fd12ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85589e04-d2dd-4c34-a6d0-57f373049180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85589e04-d2dd-4c34-a6d0-57f373049180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e07aa8f-9075-468b-bc88-3d1aed1fde58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e07aa8f-9075-468b-bc88-3d1aed1fde58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91ae828-b0cf-4d3d-976d-a0decbd5471c', 'volume_name': 'volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e846d0-16a5-4388-bde8-cd99c5a30546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e846d0-16a5-4388-bde8-cd99c5a30546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8273caba-ce99-4804-a24e-5a88fd4bd880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:48 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Volume e91ae828-b0cf-4d3d-976d-a0decbd5471c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c', 'volume_size': 1} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91ae828-b0cf-4d3d-976d-a0decbd5471c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d580a4d9644f4c61b3e67657fc7e20af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:48Z,use_quota=True,user_id='58e5746d35ba4aea9957e0c36fd12ff8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Creating volume e91ae828-b0cf-4d3d-976d-a0decbd5471c {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:48 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:48 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c 1073741824 Nov 01 08:53:48 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:49 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c 1073741824" returned: 0 in 0.505s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:49 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c Nov 01 08:53:49 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:49 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c" returned: 0 in 0.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8273caba-ce99-4804-a24e-5a88fd4bd880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa7577a-98e2-4c1c-b619-c45675f8165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Volume volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c (e91ae828-b0cf-4d3d-976d-a0decbd5471c): created successfully Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa7577a-98e2-4c1c-b619-c45675f8165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Flow 'volume_create_manager' (075855cc-2ba4-465e-b464-132ffdf0da56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8a8d4fd0-459b-4ee6-a391-f107e758acd7 tempest-VolumesListAdminTestJSON-1505083044 None] Created volume successfully. Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Acquiring lock "cinder-e91ae828-b0cf-4d3d-976d-a0decbd5471c-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "cinder-e91ae828-b0cf-4d3d-976d-a0decbd5471c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Acquiring lock "cinder-quobyte-e91ae828-b0cf-4d3d-976d-a0decbd5471c" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "cinder-quobyte-e91ae828-b0cf-4d3d-976d-a0decbd5471c" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[66962362-12c9-46b5-b1d5-9ebdfb0b835f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "cinder-b4a1d27c-7abc-4e4f-83f1-60eaddabf749-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-b4a1d27c-7abc-4e4f-83f1-60eaddabf749-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "cinder-quobyte-b4a1d27c-7abc-4e4f-83f1-60eaddabf749" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:50 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c Nov 01 08:53:50 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-quobyte-b4a1d27c-7abc-4e4f-83f1-60eaddabf749" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bfdb06-9253-4652-bd3b-a3c15b61f3c6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:51 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 Nov 01 08:53:51 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:51 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c" returned: 0 in 0.558s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:51 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c Nov 01 08:53:51 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:51 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749" returned: 0 in 0.464s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:51 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749 Nov 01 08:53:51 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:51 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e91ae828-b0cf-4d3d-976d-a0decbd5471c" returned: 0 in 0.317s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "cinder-quobyte-e91ae828-b0cf-4d3d-976d-a0decbd5471c" released by "delete_volume" :: held 0.936s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Created reservations ['d8a6623e-2012-4738-8b1a-6546a6ed71b4', '10ccd08f-a97d-4df0-a920-bc57621e6610', 'e5607ef5-076c-45a9-9c72-a242e9492a9f', '97f28cf7-353e-4a52-a05c-c33324a7cd96'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:51 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4a1d27c-7abc-4e4f-83f1-60eaddabf749" returned: 0 in 0.325s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-quobyte-b4a1d27c-7abc-4e4f-83f1-60eaddabf749" released by "delete_volume" :: held 0.849s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:51 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:51 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Created reservations ['8fab3af6-51c3-4510-9385-2f57c4249384', '43012bea-9079-4bf2-b54d-e0c8be3f1ed4', '408bb2cd-c923-4d0b-9de3-0297dcf72fd8', '7892c33b-644e-4019-9239-fc7f05cc44f1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:52 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:52 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "cinder-88fd7d7e-e432-4b2f-87d2-78baca03fab4-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-88fd7d7e-e432-4b2f-87d2-78baca03fab4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "cinder-quobyte-88fd7d7e-e432-4b2f-87d2-78baca03fab4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-quobyte-88fd7d7e-e432-4b2f-87d2-78baca03fab4" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:52 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.487s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17ed234-96f2-4f30-a27c-6f6d2e249cac]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:52 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.350s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Deleted volume successfully. Nov 01 08:53:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Deleted volume successfully. Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8fef7724-85df-492d-bfa6-79ffdc502548 tempest-VolumesListAdminTestJSON-1505083044 None] Lock "cinder-e91ae828-b0cf-4d3d-976d-a0decbd5471c-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8253d6a3-2436-4e0f-9732-01abfd7a3b9e tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-b4a1d27c-7abc-4e4f-83f1-60eaddabf749-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:52 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 Nov 01 08:53:52 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:52 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4" returned: 0 in 0.487s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:52 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4 Nov 01 08:53:52 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:53 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88fd7d7e-e432-4b2f-87d2-78baca03fab4" returned: 0 in 0.286s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-quobyte-88fd7d7e-e432-4b2f-87d2-78baca03fab4" released by "delete_volume" :: held 0.858s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Created reservations ['418315bb-3f8d-4719-b7f3-074ec987188a', 'c6443428-8c21-41fa-a15c-a72721f7765c', '049bde22-d313-4880-ac3b-6f3ba95bc11a', 'bc237e33-974b-4620-bc83-3b374fa0c694'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:53 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:53 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:53 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.291s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Deleted volume successfully. Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1673a0ba-44d0-46a4-8aa1-3c2c8108363b tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-88fd7d7e-e432-4b2f-87d2-78baca03fab4-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Flow 'volume_create_manager' (1c81ee80-0616-48c3-8fe0-15155e07c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ab5569-1315-4a2a-8e39-303e41230b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ab5569-1315-4a2a-8e39-303e41230b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1764410814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd847a7-8cd1-46d2-a3e0-20c269d0e241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bae154f78142b8a299a7d72fa06d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:54Z,use_quota=True,user_id='7d5e910cb8274bb9a279c302d4b68387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37154cb-73a9-475e-be27-434637651fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37154cb-73a9-475e-be27-434637651fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cbd55a-69ef-4d27-9e55-16aa4ee68243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cbd55a-69ef-4d27-9e55-16aa4ee68243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd847a7-8cd1-46d2-a3e0-20c269d0e241', 'volume_name': 'volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5020b77b-f0d7-4f4c-8a28-2e493f094ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5020b77b-f0d7-4f4c-8a28-2e493f094ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1701c99-8897-4205-a851-aa6721842fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:53 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Volume 6bd847a7-8cd1-46d2-a3e0-20c269d0e241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241', 'volume_size': 1} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1764410814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd847a7-8cd1-46d2-a3e0-20c269d0e241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bae154f78142b8a299a7d72fa06d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:53:54Z,use_quota=True,user_id='7d5e910cb8274bb9a279c302d4b68387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Creating volume 6bd847a7-8cd1-46d2-a3e0-20c269d0e241 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:53:53 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:53:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:53 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 1073741824 Nov 01 08:53:53 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:54 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 1073741824" returned: 0 in 0.575s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:54 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 Nov 01 08:53:54 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "cinder-4d01a242-f6aa-463d-a7f6-83c483235379-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-4d01a242-f6aa-463d-a7f6-83c483235379-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "cinder-quobyte-4d01a242-f6aa-463d-a7f6-83c483235379" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-quobyte-4d01a242-f6aa-463d-a7f6-83c483235379" acquired by "delete_volume" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61b9013-39d7-4b57-b99e-b72802685c67]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:54 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 Nov 01 08:53:54 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:54 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241" returned: 0 in 0.408s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1701c99-8897-4205-a851-aa6721842fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584b76da-bbb8-4a5f-90e9-daef6f91a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:53:54 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Volume volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 (6bd847a7-8cd1-46d2-a3e0-20c269d0e241): created successfully Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584b76da-bbb8-4a5f-90e9-daef6f91a594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Flow 'volume_create_manager' (1c81ee80-0616-48c3-8fe0-15155e07c580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:53:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5070dda6-8a68-4305-a3ec-1e857e64925a tempest-ServerActionsTestOtherA-250974556 None] Created volume successfully. Nov 01 08:53:55 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379" returned: 0 in 0.502s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:55 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379 Nov 01 08:53:55 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:55 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4d01a242-f6aa-463d-a7f6-83c483235379" returned: 0 in 0.272s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-quobyte-4d01a242-f6aa-463d-a7f6-83c483235379" released by "delete_volume" :: held 0.830s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Created reservations ['4d702e61-19b7-48a8-84d2-95fd8119f834', '1e0bb2fd-321a-4643-8a05-ce488bfddda5', 'e8debb57-4b17-4392-9a35-1b7ab183cc02', '970247f4-d02b-4099-b1d8-62fbcb71064b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:53:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:53:55 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:53:55 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:53:56 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Nov 01 08:53:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.351s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:53:56 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:53:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Deleted volume successfully. Nov 01 08:53:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b0f5904b-936b-4d67-9a67-fe102d675843 tempest-VolumesListAdminTestJSON-1516351110 None] Lock "cinder-4d01a242-f6aa-463d-a7f6-83c483235379-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Flow 'volume_create_manager' (a82d6f4b-4bc0-44f9-afab-4a68fb743047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9081d5-7294-4f91-9be2-ede57bd0127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9081d5-7294-4f91-9be2-ede57bd0127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1055061579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ebed6e-0efd-4cf8-800b-616dc7172a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762d361cdc3c434e8658c3b9e9c656ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:00Z,use_quota=True,user_id='3161c0a6073141458c120f8cae8d6e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf06b2d2-8fb8-451c-848b-77645f70e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf06b2d2-8fb8-451c-848b-77645f70e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0608126-31d9-4e3f-9bd2-4c22b451f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0608126-31d9-4e3f-9bd2-4c22b451f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ebed6e-0efd-4cf8-800b-616dc7172a39', 'volume_name': 'volume-54ebed6e-0efd-4cf8-800b-616dc7172a39', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c0e19d-3fb6-4705-a3d4-9d69acf2f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c0e19d-3fb6-4705-a3d4-9d69acf2f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e37ce8-7fc8-40bb-ab7f-2278425acaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Volume 54ebed6e-0efd-4cf8-800b-616dc7172a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ebed6e-0efd-4cf8-800b-616dc7172a39', 'volume_size': 1} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1055061579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ebed6e-0efd-4cf8-800b-616dc7172a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762d361cdc3c434e8658c3b9e9c656ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:00Z,use_quota=True,user_id='3161c0a6073141458c120f8cae8d6e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Creating volume 54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:00 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:00 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 1073741824 Nov 01 08:54:00 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:00 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 1073741824" returned: 0 in 0.624s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:00 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 Nov 01 08:54:00 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:01 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39" returned: 0 in 0.401s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:54:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e37ce8-7fc8-40bb-ab7f-2278425acaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ebed6e-0efd-4cf8-800b-616dc7172a39', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d82fb6-a53a-4b68-a53d-72ea23cdca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:01 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Volume volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 (54ebed6e-0efd-4cf8-800b-616dc7172a39): created successfully Nov 01 08:54:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d82fb6-a53a-4b68-a53d-72ea23cdca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Flow 'volume_create_manager' (a82d6f4b-4bc0-44f9-afab-4a68fb743047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:01 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e569518e-a430-41d6-b483-f566e6c28120 tempest-VolumesDeleteCascade-1501363896 None] Created volume successfully. Nov 01 08:54:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Creating offline snapshot f91d487f-daec-432f-8c59-1d685cbf516b of volume 54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:54:02 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffdc536-97e8-4316-8bf1-9f3e1c2d4b5e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:02 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 Nov 01 08:54:02 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:03 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39" returned: 0 in 0.651s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:03 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b 1G Nov 01 08:54:03 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:04 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b 1G" returned: 0 in 0.749s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:04 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b Nov 01 08:54:04 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:04 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b" returned: 0 in 0.446s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:04 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b is being set with open permissions: ugo+rw Nov 01 08:54:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:04 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b Nov 01 08:54:04 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:04 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b" returned: 0 in 0.366s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:04 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.info Nov 01 08:54:04 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:05 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.info" returned: 0 in 0.298s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:05 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.info is being set with open permissions: ugo+rw Nov 01 08:54:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:05 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.info Nov 01 08:54:05 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:05 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.info" returned: 0 in 0.286s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fed6a64d-45b9-4baf-823f-8b48d5c07dd2 tempest-VolumesDeleteCascade-1501363896 None] Create snapshot completed successfully Nov 01 08:54:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Creating offline snapshot a6cb42f6-a8f7-413a-9b10-512b795dd48d of volume 54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:54:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb3b822-9cdf-44f0-8351-e84aa6305575]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:06 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b Nov 01 08:54:06 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:06 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b" returned: 0 in 0.653s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ebed6e-0efd-4cf8-800b-616dc7172a39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:54:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:06 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d 1G Nov 01 08:54:06 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:07 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d 1G" returned: 0 in 1.024s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:07 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d Nov 01 08:54:07 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:08 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d" returned: 0 in 0.925s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:08 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d is being set with open permissions: ugo+rw Nov 01 08:54:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:08 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d Nov 01 08:54:08 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:09 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d" returned: 0 in 0.436s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.232s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7da5097b-2179-4f05-93aa-663e727b255a tempest-VolumesDeleteCascade-1501363896 None] Create snapshot completed successfully Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-54ebed6e-0efd-4cf8-800b-616dc7172a39-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-54ebed6e-0efd-4cf8-800b-616dc7172a39-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Performing cascade delete. {{(pid=86770) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-a6cb42f6-a8f7-413a-9b10-512b795dd48d-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-a6cb42f6-a8f7-413a-9b10-512b795dd48d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-a6cb42f6-a8f7-413a-9b10-512b795dd48d" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-a6cb42f6-a8f7-413a-9b10-512b795dd48d" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Deleting offline snapshot a6cb42f6-a8f7-413a-9b10-512b795dd48d of volume 54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] snapshot_file for this snap is: volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeb7a66-eb43-4ece-b6ff-32eb89811440]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:11 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d Nov 01 08:54:11 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Flow 'volume_create_manager' (97c52ab4-796b-4cb0-bac9-d067ae14608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adb5de5-c9f2-4817-8df4-4233b57ffd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adb5de5-c9f2-4817-8df4-4233b57ffd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1554426208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f0860-7c42-47db-bd55-6fa8345d58de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d2c0a5eb6f418cacf4d8275c6d2d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:11Z,use_quota=True,user_id='f91de9c7c9c44c4a9f39e547d13539a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8491d2-f76a-4d3e-9b66-43ae0cd715b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8491d2-f76a-4d3e-9b66-43ae0cd715b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19aab4a3-ac35-4dbf-985f-276a74138f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 08:54:11 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d" returned: 0 in 0.775s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ebed6e-0efd-4cf8-800b-616dc7172a39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1c1dfe-e2f8-4056-9352-9dffcf5fb58e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:12 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b Nov 01 08:54:12 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19aab4a3-ac35-4dbf-985f-276a74138f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f42f0860-7c42-47db-bd55-6fa8345d58de', 'volume_name': 'volume-f42f0860-7c42-47db-bd55-6fa8345d58de', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd153e6-7bf9-4240-a0fd-febe1192fdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd153e6-7bf9-4240-a0fd-febe1192fdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddf5698-45eb-44cb-b2e3-46c40cda4d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:12 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Volume f42f0860-7c42-47db-bd55-6fa8345d58de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f42f0860-7c42-47db-bd55-6fa8345d58de', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 08:54:12 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Trying to clone f42f0860-7c42-47db-bd55-6fa8345d58de from image 2972c011-c2ff-40ad-8107-682efa81840b at location (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 08:54:12 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b" returned: 0 in 1.037s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ebed6e-0efd-4cf8-800b-616dc7172a39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:54:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:13 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d Nov 01 08:54:13 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:13 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 08:54:13 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Image download 20.69 MB at 20.69 MB/s Nov 01 08:54:13 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77244cc-bba0-431d-8ff8-dd5e0403b51f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:13 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD Nov 01 08:54:13 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:14 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d" returned: 0 in 1.155s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:14 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b is fetched for user f91de9c7c9c44c4a9f39e547d13539a4. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 08:54:14 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d Nov 01 08:54:14 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fbe14-636e-4857-8f3b-9f4886cdf78d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:14 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.a6cb42f6-a8f7-413a-9b10-512b795dd48d" returned: 0 in 0.701s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:14 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD Nov 01 08:54:14 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-a6cb42f6-a8f7-413a-9b10-512b795dd48d" released by "_delete_snapshot" :: held 3.936s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" released by "delete_snapshot" :: held 4.024s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Created reservations ['2f3e5678-4117-4348-8796-038ebe725196', 'f7ef54c8-9818-4453-af89-ccf9997a3740', '900f973f-9cf7-4c7f-b498-dfe43cd2f9dc', '27c3b6e0-b184-4e86-ba0c-3bfb23c18495'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Delete snapshot completed successfully. Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-a6cb42f6-a8f7-413a-9b10-512b795dd48d-delete_snapshot" released by "delete_snapshot" :: held 4.402s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-f91d487f-daec-432f-8c59-1d685cbf516b-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-f91d487f-daec-432f-8c59-1d685cbf516b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-f91d487f-daec-432f-8c59-1d685cbf516b" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-f91d487f-daec-432f-8c59-1d685cbf516b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Deleting offline snapshot f91d487f-daec-432f-8c59-1d685cbf516b of volume 54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] snapshot_file for this snap is: volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2c9d37-9311-48e8-8704-d0714321f480]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:15 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD" returned: 0 in 1.069s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1554426208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f0860-7c42-47db-bd55-6fa8345d58de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d2c0a5eb6f418cacf4d8275c6d2d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:11Z,use_quota=True,user_id='f91de9c7c9c44c4a9f39e547d13539a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Creating volume f42f0860-7c42-47db-bd55-6fa8345d58de {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:15 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:54:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:15 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de 1073741824 Nov 01 08:54:15 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:15 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b Nov 01 08:54:15 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:16 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de 1073741824" returned: 0 in 1.107s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:16 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b" returned: 0 in 1.293s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54ebed6e-0efd-4cf8-800b-616dc7172a39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:54:16 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[de40690a-af22-4cde-bb1b-eb0476a8da93]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:16 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de Nov 01 08:54:16 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:17 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 Nov 01 08:54:17 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:17 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de" returned: 0 in 0.518s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Attempting download of 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume f42f0860-7c42-47db-bd55-6fa8345d58de. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[143d3565-fb96-4e1b-9423-78423b77787d]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_yc9d5fet {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:17 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39" returned: 0 in 1.007s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:17 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b Nov 01 08:54:17 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:18 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_yc9d5fet Nov 01 08:54:18 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:18 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b" returned: 0 in 0.889s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:18 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b Nov 01 08:54:18 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:18 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_yc9d5fet" returned: 0 in 1.387s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_yc9d5fet {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:19 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39.f91d487f-daec-432f-8c59-1d685cbf516b" returned: 0 in 0.587s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:19 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_yc9d5fet Nov 01 08:54:19 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-f91d487f-daec-432f-8c59-1d685cbf516b" released by "_delete_snapshot" :: held 3.947s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" released by "delete_snapshot" :: held 3.995s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Created reservations ['35105532-1ced-4e0c-a876-2bd0f7b32f40', 'e9a821b8-a5c2-408a-aa22-a2a59fc8d9c6', 'abf655ee-6b25-457f-9bc5-44069fb804b9', 'e5a964b4-e493-4073-be5e-7e50d3037eac'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Delete snapshot completed successfully. Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-f91d487f-daec-432f-8c59-1d685cbf516b-delete_snapshot" released by "delete_snapshot" :: held 4.426s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Snapshots deleted, issuing volume delete {{(pid=86770) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" acquired by "delete_volume" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4bf83b-1a5b-4567-9a3e-f839e2aeff1a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:19 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_yc9d5fet" returned: 1 in 0.899s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_yc9d5fet' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d674910-7fc8-4c6a-9077-13ba12fd6513]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:20 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 Nov 01 08:54:20 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:20 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD Nov 01 08:54:20 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:20 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:20 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] 2972c011-c2ff-40ad-8107-682efa81840b was qcow2, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 08:54:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:20 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de Nov 01 08:54:20 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:20 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39" returned: 0 in 0.960s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:20 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39 Nov 01 08:54:20 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:21 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:21 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:21 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54ebed6e-0efd-4cf8-800b-616dc7172a39" returned: 0 in 0.762s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-54ebed6e-0efd-4cf8-800b-616dc7172a39" released by "delete_volume" :: held 1.862s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Created reservations ['27db9c2f-3bf5-4b53-a661-a7a28443f67c', '1289a84a-bbd9-40d1-8ed5-e546df300300', '58f5fc73-ab12-4304-b406-740b3981e7a7', 'f4cf6a73-32f7-4c0b-ba33-77cc41fb1498'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:21 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.602s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:54:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:22 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:22 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:22 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.774s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:22 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:22 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Deleted volume successfully. Nov 01 08:54:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8f65913a-9e27-4435-8148-2cb19a673125 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-54ebed6e-0efd-4cf8-800b-616dc7172a39-delete_volume" released by "delete_volume" :: held 12.514s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:24 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de" returned: 0 in 3.996s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:24 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_g9uuse3wdevstack@QuobyteHD, size 112.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:54:24 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Converted 112.00 MB image at 28.02 MB/s Nov 01 08:54:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:24 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de 1G Nov 01 08:54:24 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Flow 'volume_create_manager' (057ed80e-c44d-4d4d-8aa2-26a4ada7c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce67cb09-e96d-4104-9a17-bf4a643d785c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce67cb09-e96d-4104-9a17-bf4a643d785c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1263990119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4130042-86ad-4f1d-acf4-19e5aae17f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762d361cdc3c434e8658c3b9e9c656ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:25Z,use_quota=True,user_id='3161c0a6073141458c120f8cae8d6e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9039369f-86c4-4e7d-946e-dfe941851f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9039369f-86c4-4e7d-946e-dfe941851f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a9b620-8d4e-4416-82ec-6e36021557de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a9b620-8d4e-4416-82ec-6e36021557de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4130042-86ad-4f1d-acf4-19e5aae17f77', 'volume_name': 'volume-b4130042-86ad-4f1d-acf4-19e5aae17f77', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6cc976-3fc9-42eb-b730-88837ed35e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6cc976-3fc9-42eb-b730-88837ed35e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bae3435-4d32-4ec9-af00-22e113765294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Volume b4130042-86ad-4f1d-acf4-19e5aae17f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4130042-86ad-4f1d-acf4-19e5aae17f77', 'volume_size': 1} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1263990119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4130042-86ad-4f1d-acf4-19e5aae17f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762d361cdc3c434e8658c3b9e9c656ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:25Z,use_quota=True,user_id='3161c0a6073141458c120f8cae8d6e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Creating volume b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:25 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:25 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de 1G" returned: 0 in 1.021s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Downloaded image 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume f42f0860-7c42-47db-bd55-6fa8345d58de successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b for user f91de9c7c9c44c4a9f39e547d13539a4 is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Marking volume f42f0860-7c42-47db-bd55-6fa8345d58de as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 08:54:25 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 1073741824 Nov 01 08:54:25 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Copying metadata from image 2972c011-c2ff-40ad-8107-682efa81840b to f42f0860-7c42-47db-bd55-6fa8345d58de. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Creating volume glance metadata for volume f42f0860-7c42-47db-bd55-6fa8345d58de backed by image 2972c011-c2ff-40ad-8107-682efa81840b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddf5698-45eb-44cb-b2e3-46c40cda4d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42f0860-7c42-47db-bd55-6fa8345d58de', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d25db50-adb8-49ce-97f9-a5742acb0a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Volume volume-f42f0860-7c42-47db-bd55-6fa8345d58de (f42f0860-7c42-47db-bd55-6fa8345d58de): created successfully Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d25db50-adb8-49ce-97f9-a5742acb0a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Flow 'volume_create_manager' (97c52ab4-796b-4cb0-bac9-d067ae14608b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0f5308ce-068e-4bbb-8d6c-bdbd1c1c6c62 tempest-VolumesImageMetadata-991176902 None] Created volume successfully. Nov 01 08:54:26 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 1073741824" returned: 0 in 0.778s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:26 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 Nov 01 08:54:26 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:26 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77" returned: 0 in 0.281s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bae3435-4d32-4ec9-af00-22e113765294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4130042-86ad-4f1d-acf4-19e5aae17f77', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80da66bb-4efe-4d01-97fa-f8205fe0678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Volume volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 (b4130042-86ad-4f1d-acf4-19e5aae17f77): created successfully Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80da66bb-4efe-4d01-97fa-f8205fe0678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Flow 'volume_create_manager' (057ed80e-c44d-4d4d-8aa2-26a4ada7c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:26 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4dbb22d0-07be-40b6-9d68-5c90ed439eb4 tempest-VolumesDeleteCascade-1501363896 None] Created volume successfully. Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Acquiring lock "cinder-f42f0860-7c42-47db-bd55-6fa8345d58de-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Lock "cinder-f42f0860-7c42-47db-bd55-6fa8345d58de-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Acquiring lock "cinder-quobyte-f42f0860-7c42-47db-bd55-6fa8345d58de" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Lock "cinder-quobyte-f42f0860-7c42-47db-bd55-6fa8345d58de" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7813e1cc-7fb1-4ea5-9e32-3713056ddc60]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Creating offline snapshot b15c84d4-ae0f-41dd-bc34-c72c4bb17359 of volume b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[da184498-29dc-4ddb-a9de-ddbbd2fc3096]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:27 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de Nov 01 08:54:27 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:27 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 Nov 01 08:54:27 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:28 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de" returned: 0 in 0.557s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:28 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de Nov 01 08:54:28 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:28 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77" returned: 0 in 0.523s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:28 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 1G Nov 01 08:54:28 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:28 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f42f0860-7c42-47db-bd55-6fa8345d58de" returned: 0 in 0.379s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Lock "cinder-quobyte-f42f0860-7c42-47db-bd55-6fa8345d58de" released by "delete_volume" :: held 1.097s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Created reservations ['3f2a90d2-1799-4d8f-af81-0838f3061a78', '94557573-98b0-4bf3-88c6-7cd7764f862e', '9d6ca73a-4c41-41a3-93e2-1566c2fd34b8', 'b31aa44f-cdb3-4f57-9436-6a38c8a07042'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:28 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 1G" returned: 0 in 0.602s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:28 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:28 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:28 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 Nov 01 08:54:28 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:29 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.273s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:29 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Deleted volume successfully. Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c521121f-13fa-4fa6-94fa-cfc29ef0f5db tempest-VolumesImageMetadata-991176902 None] Lock "cinder-f42f0860-7c42-47db-bd55-6fa8345d58de-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:29 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359" returned: 0 in 0.347s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:29 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 is being set with open permissions: ugo+rw Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:29 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 Nov 01 08:54:29 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:29 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359" returned: 0 in 0.243s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:29 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.info Nov 01 08:54:29 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:29 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.info" returned: 0 in 0.279s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:29 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.info is being set with open permissions: ugo+rw Nov 01 08:54:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:29 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.info Nov 01 08:54:29 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:30 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.info" returned: 0 in 0.290s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-79764303-44ee-42f5-aa59-5500a881b5e9 tempest-VolumesDeleteCascade-1501363896 None] Create snapshot completed successfully Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Flow 'volume_create_manager' (4e8fa1cc-125b-483f-a2ef-1ef8a8b74f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367b7a7c-57b3-4b0f-b9fb-9acf67509673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367b7a7c-57b3-4b0f-b9fb-9acf67509673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-390945248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9812a090-f3e2-47fa-adb0-7575a4141e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155ea40598e24a8b881c55d766c882bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:31Z,use_quota=True,user_id='13e1b865c4a346f9845629aac0073b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80d10b9-5211-4d7c-99da-09c7b0613003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80d10b9-5211-4d7c-99da-09c7b0613003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba195e3-2c4d-4674-b74c-48686e9179cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba195e3-2c4d-4674-b74c-48686e9179cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9812a090-f3e2-47fa-adb0-7575a4141e74', 'volume_name': 'volume-9812a090-f3e2-47fa-adb0-7575a4141e74', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669643f7-e6c8-4f62-853f-c9a0ce4e07cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669643f7-e6c8-4f62-853f-c9a0ce4e07cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9e3fba-1912-477b-afc0-cd18f610fe8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:30 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Volume 9812a090-f3e2-47fa-adb0-7575a4141e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9812a090-f3e2-47fa-adb0-7575a4141e74', 'volume_size': 1} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-390945248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9812a090-f3e2-47fa-adb0-7575a4141e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155ea40598e24a8b881c55d766c882bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:31Z,use_quota=True,user_id='13e1b865c4a346f9845629aac0073b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Creating volume 9812a090-f3e2-47fa-adb0-7575a4141e74 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:30 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:54:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:30 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 1073741824 Nov 01 08:54:30 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:31 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 1073741824" returned: 0 in 0.556s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:31 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 Nov 01 08:54:31 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Flow 'volume_create_manager' (b1afa5ff-a7ac-4065-b38e-ab057317b09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37768ad4-cde0-485f-b7af-c65adcd0028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37768ad4-cde0-485f-b7af-c65adcd0028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1254018159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20377662-a25b-41d1-b035-3acae52fdd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762d361cdc3c434e8658c3b9e9c656ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b15c84d4-ae0f-41dd-bc34-c72c4bb17359,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:31Z,use_quota=True,user_id='3161c0a6073141458c120f8cae8d6e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45d3fed-b959-4158-af1c-d1dda8acf2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45d3fed-b959-4158-af1c-d1dda8acf2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2741633d-9093-4276-8adf-dc572e4d78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2741633d-9093-4276-8adf-dc572e4d78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20377662-a25b-41d1-b035-3acae52fdd90', 'volume_name': 'volume-20377662-a25b-41d1-b035-3acae52fdd90', 'volume_size': 1, 'snapshot_id': 'b15c84d4-ae0f-41dd-bc34-c72c4bb17359'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e24c73b-1230-413c-a174-99964eb2e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e24c73b-1230-413c-a174-99964eb2e576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808540d1-704f-4698-be57-52ca1c15ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Volume 20377662-a25b-41d1-b035-3acae52fdd90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20377662-a25b-41d1-b035-3acae52fdd90', 'volume_size': 1, 'snapshot_id': 'b15c84d4-ae0f-41dd-bc34-c72c4bb17359'} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:31 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74" returned: 0 in 0.404s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.058s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-b15c84d4-ae0f-41dd-bc34-c72c4bb17359-20377662-a25b-41d1-b035-3acae52fdd90" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b15c84d4-ae0f-41dd-bc34-c72c4bb17359-20377662-a25b-41d1-b035-3acae52fdd90" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Creating volume 20377662-a25b-41d1-b035-3acae52fdd90 from snapshot b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-20377662-a25b-41d1-b035-3acae52fdd90" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9e3fba-1912-477b-afc0-cd18f610fe8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9812a090-f3e2-47fa-adb0-7575a4141e74', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2f4f8e-a9cc-4036-aa04-3b3ae9ef7d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Volume volume-9812a090-f3e2-47fa-adb0-7575a4141e74 (9812a090-f3e2-47fa-adb0-7575a4141e74): created successfully Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2f4f8e-a9cc-4036-aa04-3b3ae9ef7d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Flow 'volume_create_manager' (4e8fa1cc-125b-483f-a2ef-1ef8a8b74f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-20377662-a25b-41d1-b035-3acae52fdd90" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] snapshot: b15c84d4-ae0f-41dd-bc34-c72c4bb17359, volume: 20377662-a25b-41d1-b035-3acae52fdd90, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 08:54:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a702bb13-b777-403e-9454-a9260f97a441 tempest-ServersNegativeTestJSON-2127920021 None] Created volume successfully. Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaa7147-df4e-461b-8404-fc684d7079b2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:32 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 Nov 01 08:54:32 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:32 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359" returned: 0 in 0.528s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4130042-86ad-4f1d-acf4-19e5aae17f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:54:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1ba11-bcfc-4531-8b61-e4638b51f54e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:32 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 Nov 01 08:54:32 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:33 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77" returned: 0 in 0.572s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 08:54:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 08:54:33 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 08:54:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:33 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 Nov 01 08:54:33 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Flow 'volume_create_manager' (e8f965db-0714-4b00-921f-a6999ba8029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45fd499-d250-454a-8c32-484ccf7256a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Flow 'volume_create_manager' (4832fb5d-3ea7-4aff-ae70-04e99d196aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf51eaf-c125-4768-9ee6-3870c9557089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45fd499-d250-454a-8c32-484ccf7256a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1731461609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe00c1f8-c122-491f-8a8c-4f97fa0b69db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155ea40598e24a8b881c55d766c882bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:36Z,use_quota=True,user_id='13e1b865c4a346f9845629aac0073b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6b2bc4-d839-4e88-8915-b46b880633ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6b2bc4-d839-4e88-8915-b46b880633ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead2d4ab-4113-49a3-b90c-258473e8e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead2d4ab-4113-49a3-b90c-258473e8e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe00c1f8-c122-491f-8a8c-4f97fa0b69db', 'volume_name': 'volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd53b8e-9a4c-474d-83ff-2b37fd25b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd53b8e-9a4c-474d-83ff-2b37fd25b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fac35ae-a1e0-47d6-8e20-e1ce98f4ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Volume fe00c1f8-c122-491f-8a8c-4f97fa0b69db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db', 'volume_size': 1} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf51eaf-c125-4768-9ee6-3870c9557089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135543553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1c9114-990f-4feb-9a48-2244e0b251c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fced29808e4c1dad659b97e3716a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:36Z,use_quota=True,user_id='e8b12f100345461287ca8591c057fafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17670355-6470-4876-b43a-9b6073998861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17670355-6470-4876-b43a-9b6073998861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02458988-311f-451b-bad5-23009b48634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02458988-311f-451b-bad5-23009b48634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1c9114-990f-4feb-9a48-2244e0b251c6', 'volume_name': 'volume-bd1c9114-990f-4feb-9a48-2244e0b251c6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a860408e-31d0-4aea-8880-29f06810053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a860408e-31d0-4aea-8880-29f06810053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3362fd23-f055-4c5f-babc-e972f059bdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Volume bd1c9114-990f-4feb-9a48-2244e0b251c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1c9114-990f-4feb-9a48-2244e0b251c6', 'volume_size': 1} Nov 01 08:54:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=78,cinder:UPDATE=88,cinder:INSERT=30,cinder:DELETE=10 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:54:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=84,cinder:UPDATE=99,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:54:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-cd5b3dc7-c60b-47df-835b-c56fba821556 req-6942d3c6-7ea9-42f7-a29a-ad6b1bf18dba tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:40 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90" returned: 0 in 7.752s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:40 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:54:40 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Converted 1024.00 MB image at 132.05 MB/s Nov 01 08:54:40 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 is being set with open permissions: ugo+rw Nov 01 08:54:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:40 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 Nov 01 08:54:40 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:41 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90" returned: 0 in 0.263s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-20377662-a25b-41d1-b035-3acae52fdd90" released by "_copy_volume_from_snapshot" :: held 9.278s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b15c84d4-ae0f-41dd-bc34-c72c4bb17359-20377662-a25b-41d1-b035-3acae52fdd90" released by "_create_volume_from_snapshot" :: held 9.389s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.407s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.484s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1731461609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe00c1f8-c122-491f-8a8c-4f97fa0b69db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155ea40598e24a8b881c55d766c882bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:36Z,use_quota=True,user_id='13e1b865c4a346f9845629aac0073b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Creating volume fe00c1f8-c122-491f-8a8c-4f97fa0b69db {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:41 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:41 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db 1073741824 Nov 01 08:54:41 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808540d1-704f-4698-be57-52ca1c15ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20377662-a25b-41d1-b035-3acae52fdd90', 'volume_size': 1, 'snapshot_id': 'b15c84d4-ae0f-41dd-bc34-c72c4bb17359'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6e422d-2c6d-4bba-9adf-a0e984d927e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:41 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Volume volume-20377662-a25b-41d1-b035-3acae52fdd90 (20377662-a25b-41d1-b035-3acae52fdd90): created successfully Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6e422d-2c6d-4bba-9adf-a0e984d927e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Flow 'volume_create_manager' (b1afa5ff-a7ac-4065-b38e-ab057317b09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-708391c0-712d-4c98-8197-6ebf1a3d2ba9 tempest-VolumesDeleteCascade-1501363896 None] Created volume successfully. Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-b4130042-86ad-4f1d-acf4-19e5aae17f77-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-b4130042-86ad-4f1d-acf4-19e5aae17f77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Performing cascade delete. {{(pid=86770) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-b15c84d4-ae0f-41dd-bc34-c72c4bb17359-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-b15c84d4-ae0f-41dd-bc34-c72c4bb17359-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-b4130042-86ad-4f1d-acf4-19e5aae17f77" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b4130042-86ad-4f1d-acf4-19e5aae17f77" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-b15c84d4-ae0f-41dd-bc34-c72c4bb17359" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b15c84d4-ae0f-41dd-bc34-c72c4bb17359" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Deleting offline snapshot b15c84d4-ae0f-41dd-bc34-c72c4bb17359 of volume b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] snapshot_file for this snap is: volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccc5f9d-eedc-4c3e-8f60-23f338064b33]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:41 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db 1073741824" returned: 0 in 0.543s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:41 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db Nov 01 08:54:41 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:41 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 Nov 01 08:54:41 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:41 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.241s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135543553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1c9114-990f-4feb-9a48-2244e0b251c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77fced29808e4c1dad659b97e3716a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:36Z,use_quota=True,user_id='e8b12f100345461287ca8591c057fafc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Creating volume bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:42 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fac35ae-a1e0-47d6-8e20-e1ce98f4ff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f4496a-626a-413e-bde8-8be066027ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:42 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 1073741824 Nov 01 08:54:42 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:42 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Volume volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db (fe00c1f8-c122-491f-8a8c-4f97fa0b69db): created successfully Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f4496a-626a-413e-bde8-8be066027ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Flow 'volume_create_manager' (e8f965db-0714-4b00-921f-a6999ba8029f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1baddb82-e676-4329-9946-70e20553606f tempest-ServersNegativeTestJSON-2127920021 None] Created volume successfully. Nov 01 08:54:42 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359" returned: 0 in 0.396s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4130042-86ad-4f1d-acf4-19e5aae17f77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc567bf8-1122-4dbb-bfaa-a159d8dfa44a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:42 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 Nov 01 08:54:42 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:42 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 1073741824" returned: 0 in 0.574s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:42 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 Nov 01 08:54:42 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:42 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77" returned: 0 in 0.686s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:42 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 Nov 01 08:54:42 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "cinder-fe00c1f8-c122-491f-8a8c-4f97fa0b69db-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-fe00c1f8-c122-491f-8a8c-4f97fa0b69db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:42 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6" returned: 0 in 0.336s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-cd5b3dc7-c60b-47df-835b-c56fba821556 req-6942d3c6-7ea9-42f7-a29a-ad6b1bf18dba tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.368s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "cinder-quobyte-fe00c1f8-c122-491f-8a8c-4f97fa0b69db" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-cd5b3dc7-c60b-47df-835b-c56fba821556 req-6942d3c6-7ea9-42f7-a29a-ad6b1bf18dba tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3362fd23-f055-4c5f-babc-e972f059bdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1c9114-990f-4feb-9a48-2244e0b251c6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d611c2-278e-465f-a388-397e50a75058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-quobyte-fe00c1f8-c122-491f-8a8c-4f97fa0b69db" acquired by "delete_volume" :: waited 0.039s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:43 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Volume volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 (bd1c9114-990f-4feb-9a48-2244e0b251c6): created successfully Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d611c2-278e-465f-a388-397e50a75058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Flow 'volume_create_manager' (4832fb5d-3ea7-4aff-ae70-04e99d196aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[60696144-0d6d-461f-8112-e807aa50cc1e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fdece9f6-5b11-47e2-b918-c0264b11f5c1 tempest-SnapshotMetadataTestJSON-1670993164 None] Created volume successfully. Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-cd5b3dc7-c60b-47df-835b-c56fba821556 req-6942d3c6-7ea9-42f7-a29a-ad6b1bf18dba tempest-ServerActionsTestOtherA-250974556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fb7d1ea-7e3c-41d8-a3f9-7aaa8c6b26bb', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:54:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-cd5b3dc7-c60b-47df-835b-c56fba821556 req-6942d3c6-7ea9-42f7-a29a-ad6b1bf18dba tempest-ServerActionsTestOtherA-250974556 None] attachment_update completed successfully. Nov 01 08:54:43 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db Nov 01 08:54:43 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:43 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359" returned: 0 in 0.474s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:43 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359 Nov 01 08:54:43 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:43 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:43 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77.b15c84d4-ae0f-41dd-bc34-c72c4bb17359" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db" returned: 0 in 0.603s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b15c84d4-ae0f-41dd-bc34-c72c4bb17359" released by "_delete_snapshot" :: held 2.084s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b4130042-86ad-4f1d-acf4-19e5aae17f77" released by "delete_snapshot" :: held 2.129s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:43 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db Nov 01 08:54:43 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Created reservations ['5d1b31b9-e4c1-487c-a466-684556b3ff4b', 'bdb7a585-6961-4ba0-92a1-e354df27218c', '01c655eb-df7f-4739-8774-65254004d7b1', 'efeb6cd4-9286-49a4-b73f-8874cc543948'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Delete snapshot completed successfully. Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-b15c84d4-ae0f-41dd-bc34-c72c4bb17359-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Snapshots deleted, issuing volume delete {{(pid=86770) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 08:54:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-b4130042-86ad-4f1d-acf4-19e5aae17f77" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b4130042-86ad-4f1d-acf4-19e5aae17f77" acquired by "delete_volume" :: waited 0.047s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[18580b8d-ce1d-417a-8f2d-7aa277acf42b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:44 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fe00c1f8-c122-491f-8a8c-4f97fa0b69db" returned: 0 in 0.472s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-quobyte-fe00c1f8-c122-491f-8a8c-4f97fa0b69db" released by "delete_volume" :: held 1.162s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Creating offline snapshot 77c7080f-1020-4de2-827d-db8a32956e22 of volume bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b55540-1f0a-4a1e-b820-1b96e80ae4c6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Created reservations ['85395db5-90c3-4209-bacf-7793f235c6cc', 'd017ff2d-fd9a-430b-9c53-64fbb6fe8aa0', '649d2d90-d441-4fe9-a4cc-9a918acb9eb8', '09051311-aa78-47c1-a97d-220026f04ce6'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:44 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 Nov 01 08:54:44 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:44 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 Nov 01 08:54:44 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:44 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:44 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:44 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77" returned: 0 in 0.514s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:44 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77 Nov 01 08:54:44 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:44 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6" returned: 0 in 0.506s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:44 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.319s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Deleted volume successfully. Nov 01 08:54:44 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 1G Nov 01 08:54:44 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-538d373d-e85c-4d4b-bfbd-3c3dd9cd0c56 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-fe00c1f8-c122-491f-8a8c-4f97fa0b69db-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:44 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4130042-86ad-4f1d-acf4-19e5aae17f77" returned: 0 in 0.284s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-b4130042-86ad-4f1d-acf4-19e5aae17f77" released by "delete_volume" :: held 0.932s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Created reservations ['34f4d32b-e038-4eab-966b-ec7243061322', '2dbff726-8b95-4a9e-ad53-a2ce1360e169', '3dfd87fa-98e2-429f-b34f-d653aa72dd07', 'bee9ff0b-80e1-43fd-bf44-3f5fc85e303c'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:45 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:45 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "cinder-9812a090-f3e2-47fa-adb0-7575a4141e74-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-9812a090-f3e2-47fa-adb0-7575a4141e74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "cinder-quobyte-9812a090-f3e2-47fa-adb0-7575a4141e74" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-quobyte-9812a090-f3e2-47fa-adb0-7575a4141e74" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:45 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 1G" returned: 0 in 0.600s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367712f-a7fa-417f-8355-e9b66a82a67c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:45 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 Nov 01 08:54:45 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:45 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.294s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Deleted volume successfully. Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9a85810e-ee86-4eb6-b6ac-774df98a3478 tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-b4130042-86ad-4f1d-acf4-19e5aae17f77-delete_volume" released by "delete_volume" :: held 3.963s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:45 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 Nov 01 08:54:45 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:45 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22" returned: 0 in 0.338s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:45 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 is being set with open permissions: ugo+rw Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:45 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 Nov 01 08:54:45 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:45 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74" returned: 0 in 0.411s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:45 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74 Nov 01 08:54:45 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:46 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:46 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.info Nov 01 08:54:46 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:46 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9812a090-f3e2-47fa-adb0-7575a4141e74" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-quobyte-9812a090-f3e2-47fa-adb0-7575a4141e74" released by "delete_volume" :: held 0.849s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Created reservations ['a52b63b4-a45d-4afc-9e49-c61f7427b82a', '055ee4db-4582-4eb4-a727-61a1673aa264', '852900be-36be-401a-94d5-a57966283e3f', 'c3721878-11b4-4094-89d6-6b07309a5088'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-20377662-a25b-41d1-b035-3acae52fdd90-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:46 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:46 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-20377662-a25b-41d1-b035-3acae52fdd90-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "cinder-quobyte-20377662-a25b-41d1-b035-3acae52fdd90" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-20377662-a25b-41d1-b035-3acae52fdd90" acquired by "delete_volume" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:46 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.info" returned: 0 in 0.464s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:46 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.info is being set with open permissions: ugo+rw Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e89c0b9-5b4d-4660-b5fd-5c8411e36b86]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:46 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.info Nov 01 08:54:46 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:46 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 Nov 01 08:54:46 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:46 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.495s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Deleted volume successfully. Nov 01 08:54:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e982a025-f1d6-40dc-a551-029aa8431e67 tempest-ServersNegativeTestJSON-2127920021 None] Lock "cinder-9812a090-f3e2-47fa-adb0-7575a4141e74-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:47 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.info" returned: 0 in 0.467s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-dda2efa9-d059-408f-8f5b-b251d66baccb tempest-SnapshotMetadataTestJSON-1670993164 None] Create snapshot completed successfully Nov 01 08:54:47 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90" returned: 0 in 0.573s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:47 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90 Nov 01 08:54:47 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:47 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-20377662-a25b-41d1-b035-3acae52fdd90" returned: 0 in 0.552s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-quobyte-20377662-a25b-41d1-b035-3acae52fdd90" released by "delete_volume" :: held 1.229s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Created reservations ['aefe9b32-413f-4498-bc84-9df6333d863c', '4b9765ae-2904-4e1e-86f1-88934c30c898', '95b636a2-7592-40c4-a158-93847a233062', '76552bae-7ba4-41ce-af58-e6e817dfcf54'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-4c78d9b2-edc6-4064-a99b-3b32f5695119 req-4e1b1e8e-424a-4608-823d-d948e6b38d1c tempest-ServerActionsTestOtherA-250974556 None] Terminate volume connection completed successfully. Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-4c78d9b2-edc6-4064-a99b-3b32f5695119 req-4e1b1e8e-424a-4608-823d-d948e6b38d1c tempest-ServerActionsTestOtherA-250974556 None] Deleting attachment 0fb7d1ea-7e3c-41d8-a3f9-7aaa8c6b26bb. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:48 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:48 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:48 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.755s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:48 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:48 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Deleted volume successfully. Nov 01 08:54:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0d9f16a1-00b0-4dc2-b538-c7c8219faf9b tempest-VolumesDeleteCascade-1501363896 None] Lock "cinder-20377662-a25b-41d1-b035-3acae52fdd90-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "cinder-77c7080f-1020-4de2-827d-db8a32956e22-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-77c7080f-1020-4de2-827d-db8a32956e22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "cinder-quobyte-bd1c9114-990f-4feb-9a48-2244e0b251c6" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-quobyte-bd1c9114-990f-4feb-9a48-2244e0b251c6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "cinder-quobyte-77c7080f-1020-4de2-827d-db8a32956e22" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-quobyte-77c7080f-1020-4de2-827d-db8a32956e22" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Deleting offline snapshot 77c7080f-1020-4de2-827d-db8a32956e22 of volume bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] snapshot_file for this snap is: volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[921f9311-3ff9-49a9-8df2-5bfd042d2bc8]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:49 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 Nov 01 08:54:49 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-4c78d9b2-edc6-4064-a99b-3b32f5695119 req-59f8f74d-e7cd-42b6-a529-54c603d7d5e2 tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-4c78d9b2-edc6-4064-a99b-3b32f5695119 req-59f8f74d-e7cd-42b6-a529-54c603d7d5e2 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-4c78d9b2-edc6-4064-a99b-3b32f5695119 req-59f8f74d-e7cd-42b6-a529-54c603d7d5e2 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-4c78d9b2-edc6-4064-a99b-3b32f5695119 req-59f8f74d-e7cd-42b6-a529-54c603d7d5e2 tempest-ServerActionsTestOtherA-250974556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca0f40b1-2c20-46be-aa87-872607dc90a1', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:54:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-4c78d9b2-edc6-4064-a99b-3b32f5695119 req-59f8f74d-e7cd-42b6-a529-54c603d7d5e2 tempest-ServerActionsTestOtherA-250974556 None] attachment_update completed successfully. Nov 01 08:54:50 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22" returned: 0 in 0.757s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1c9114-990f-4feb-9a48-2244e0b251c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:54:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e97c647-d684-45bf-93e2-6a9abb6b7a7b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:50 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 Nov 01 08:54:50 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:50 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6" returned: 0 in 0.485s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:50 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 Nov 01 08:54:50 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:51 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22" returned: 0 in 0.498s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:51 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22 Nov 01 08:54:51 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:51 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6.77c7080f-1020-4de2-827d-db8a32956e22" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-quobyte-77c7080f-1020-4de2-827d-db8a32956e22" released by "_delete_snapshot" :: held 2.524s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-quobyte-bd1c9114-990f-4feb-9a48-2244e0b251c6" released by "delete_snapshot" :: held 2.601s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Created reservations ['58cbeaed-5c51-4d9e-8a59-ffd30f25ee9d', '0f1578f7-110d-4425-be94-b82ef14012b4', 'eb88aba1-9c40-4158-9a37-ceb39e2a4491', '2d124aba-3772-4926-aea4-258c3f9fea77'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Delete snapshot completed successfully. Nov 01 08:54:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a601f0a8-5edd-4cba-91a7-f6bb7dc5bc73 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-77c7080f-1020-4de2-827d-db8a32956e22-delete_snapshot" released by "delete_snapshot" :: held 2.877s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "cinder-bd1c9114-990f-4feb-9a48-2244e0b251c6-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-bd1c9114-990f-4feb-9a48-2244e0b251c6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "cinder-quobyte-bd1c9114-990f-4feb-9a48-2244e0b251c6" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:54:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-quobyte-bd1c9114-990f-4feb-9a48-2244e0b251c6" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:54:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4027e6e-9eac-4f73-8ee7-b9bea5cf95fd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:54:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:52 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 Nov 01 08:54:52 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:53 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6" returned: 0 in 0.542s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:53 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6 Nov 01 08:54:53 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:53 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd1c9114-990f-4feb-9a48-2244e0b251c6" returned: 0 in 0.395s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-quobyte-bd1c9114-990f-4feb-9a48-2244e0b251c6" released by "delete_volume" :: held 1.078s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Created reservations ['0adf3183-c736-4c3f-b085-94e8017bdfff', '2fc054d3-641f-4463-8328-deaf09ed2a85', 'c5598b55-465a-403e-9f1a-b7f6443eca3f', '1b35cf29-817b-469b-8435-aecf8f680160'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:53 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:54:53 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:54 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.548s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:54 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:54:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Deleted volume successfully. Nov 01 08:54:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-789b33a1-1931-4a38-b876-6d51c9a20257 tempest-SnapshotMetadataTestJSON-1670993164 None] Lock "cinder-bd1c9114-990f-4feb-9a48-2244e0b251c6-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Flow 'volume_create_manager' (01af3c97-7a04-4301-b2b4-d3dcbb4b5b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87550c7-ed06-4b0f-8411-6fb05aeaf7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87550c7-ed06-4b0f-8411-6fb05aeaf7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-235878693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3be5c95-498c-4772-ba21-801b13abb087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d7e003bd8e4bb9adf37a38bdb13e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:58Z,use_quota=True,user_id='227665f3eaa54e3790b1694dfcb17198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1b5cab-e6a5-4e9f-a19f-91add0afc5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1b5cab-e6a5-4e9f-a19f-91add0afc5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d876174-d0e7-480f-a351-c1ccb047bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d876174-d0e7-480f-a351-c1ccb047bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3be5c95-498c-4772-ba21-801b13abb087', 'volume_name': 'volume-e3be5c95-498c-4772-ba21-801b13abb087', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402ef86a-1ccc-418c-9000-272ff94ab029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402ef86a-1ccc-418c-9000-272ff94ab029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7f76c-de3e-4502-9e2d-3699b47d67fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:58 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Volume e3be5c95-498c-4772-ba21-801b13abb087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3be5c95-498c-4772-ba21-801b13abb087', 'volume_size': 1} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-235878693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3be5c95-498c-4772-ba21-801b13abb087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d7e003bd8e4bb9adf37a38bdb13e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:54:58Z,use_quota=True,user_id='227665f3eaa54e3790b1694dfcb17198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Creating volume e3be5c95-498c-4772-ba21-801b13abb087 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:54:58 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:58 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 1073741824 Nov 01 08:54:58 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:58 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 1073741824" returned: 0 in 0.631s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:54:58 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 Nov 01 08:54:58 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:54:59 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Nov 01 08:54:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087" returned: 0 in 0.295s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:54:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:54:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:54:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7f76c-de3e-4502-9e2d-3699b47d67fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3be5c95-498c-4772-ba21-801b13abb087', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec41987-c08b-4d84-b32d-e2e0fae4cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:54:59 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Volume volume-e3be5c95-498c-4772-ba21-801b13abb087 (e3be5c95-498c-4772-ba21-801b13abb087): created successfully Nov 01 08:54:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec41987-c08b-4d84-b32d-e2e0fae4cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:54:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Flow 'volume_create_manager' (01af3c97-7a04-4301-b2b4-d3dcbb4b5b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:54:59 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-33428fe2-3f15-4da5-83ff-844163a17208 tempest-VolumesTransfersV355Test-1048509260 None] Created volume successfully. Nov 01 08:55:01 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2913345a-02bf-432d-a42f-fcd6082d5769 tempest-VolumesTransfersV355Test-2115853169 None] Transfer volume completed successfully. Nov 01 08:55:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Acquiring lock "cinder-e3be5c95-498c-4772-ba21-801b13abb087-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-e3be5c95-498c-4772-ba21-801b13abb087-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Acquiring lock "cinder-quobyte-e3be5c95-498c-4772-ba21-801b13abb087" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-quobyte-e3be5c95-498c-4772-ba21-801b13abb087" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:02 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d6fa5c-e59d-4cf1-92f4-355047870556]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:02 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 Nov 01 08:55:02 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Flow 'volume_create_manager' (2ab87b7f-f859-4299-b9f6-d09df29acefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f88399-0e9c-47c0-ac0f-8644e1f0458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f88399-0e9c-47c0-ac0f-8644e1f0458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1928788730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e171ce-20f9-4a12-adf6-5d937c8c4165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4976f36ba1488a9d5f6aab833a7cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:03Z,use_quota=True,user_id='6ad991ec0c614c1a900f45a31b80e83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d40c544-1e7a-4c0d-a0dc-b2741548c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d40c544-1e7a-4c0d-a0dc-b2741548c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee97c579-7b9b-4fb0-a759-e3fdc9f24a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee97c579-7b9b-4fb0-a759-e3fdc9f24a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e171ce-20f9-4a12-adf6-5d937c8c4165', 'volume_name': 'volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab34553f-ea06-40cf-8760-8cf06b7f9e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab34553f-ea06-40cf-8760-8cf06b7f9e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf558775-6aa1-464c-acf1-16aa2b638ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:03 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Volume b7e171ce-20f9-4a12-adf6-5d937c8c4165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165', 'volume_size': 1} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1928788730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e171ce-20f9-4a12-adf6-5d937c8c4165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4976f36ba1488a9d5f6aab833a7cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:03Z,use_quota=True,user_id='6ad991ec0c614c1a900f45a31b80e83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Creating volume b7e171ce-20f9-4a12-adf6-5d937c8c4165 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:03 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:03 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087" returned: 0 in 0.612s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:03 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 1073741824 Nov 01 08:55:03 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:03 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087 Nov 01 08:55:03 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:03 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e3be5c95-498c-4772-ba21-801b13abb087" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-quobyte-e3be5c95-498c-4772-ba21-801b13abb087" released by "delete_volume" :: held 1.057s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Created reservations ['f967bc8b-618d-40fc-bb20-2f68dcae55c4', '6d0aab45-f317-4775-85a6-e89eef3230e9', '770a97c3-fab9-489f-b13d-aecd99088281', '91c4e26e-cd0e-44eb-bee3-7151c2c1e54a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:03 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:04 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:04 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 1073741824" returned: 0 in 0.702s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:04 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 Nov 01 08:55:04 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:04 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:04 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Deleted volume successfully. Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d10993e0-e31b-4bb3-baef-9f44bb363181 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-e3be5c95-498c-4772-ba21-801b13abb087-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:04 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165" returned: 0 in 0.344s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf558775-6aa1-464c-acf1-16aa2b638ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b595620-18ab-4b74-8376-9790040ab531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:04 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Volume volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 (b7e171ce-20f9-4a12-adf6-5d937c8c4165): created successfully Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b595620-18ab-4b74-8376-9790040ab531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Flow 'volume_create_manager' (2ab87b7f-f859-4299-b9f6-d09df29acefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:04 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-442227af-50c8-4f40-8955-bcdf35145951 tempest-VolumesTransfersV357Test-882343744 None] Created volume successfully. Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Flow 'volume_create_manager' (33aa2cd7-3d8c-4774-a426-064a76df712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65e7d27-99ae-4af1-a469-e02bf72efad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65e7d27-99ae-4af1-a469-e02bf72efad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-328607631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f52f5fb-96de-408a-b0ed-6239ca00413d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d7e003bd8e4bb9adf37a38bdb13e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:06Z,use_quota=True,user_id='227665f3eaa54e3790b1694dfcb17198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc0fe4e-9417-4c58-92cc-83cfd4bd358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc0fe4e-9417-4c58-92cc-83cfd4bd358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f5f68c-0ca1-45cc-a51a-d4d5e712e147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f5f68c-0ca1-45cc-a51a-d4d5e712e147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f52f5fb-96de-408a-b0ed-6239ca00413d', 'volume_name': 'volume-3f52f5fb-96de-408a-b0ed-6239ca00413d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779740d7-c72c-471b-b0cc-ce11eacd5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779740d7-c72c-471b-b0cc-ce11eacd5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84667ae8-4015-4c57-9d6b-85920aae8314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Volume 3f52f5fb-96de-408a-b0ed-6239ca00413d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f52f5fb-96de-408a-b0ed-6239ca00413d', 'volume_size': 1} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-328607631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f52f5fb-96de-408a-b0ed-6239ca00413d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d7e003bd8e4bb9adf37a38bdb13e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:06Z,use_quota=True,user_id='227665f3eaa54e3790b1694dfcb17198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Creating volume 3f52f5fb-96de-408a-b0ed-6239ca00413d {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:05 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:05 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d 1073741824 Nov 01 08:55:05 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-867840bf-9fd1-4651-b472-693d8e7947a8 tempest-VolumesTransfersV357Test-219873117 None] Transfer volume completed successfully. Nov 01 08:55:06 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d 1073741824" returned: 0 in 0.799s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:06 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d Nov 01 08:55:06 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:07 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d" returned: 0 in 0.430s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84667ae8-4015-4c57-9d6b-85920aae8314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f52f5fb-96de-408a-b0ed-6239ca00413d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d7a9e2-d9c5-4888-8142-3f5fc8dc93a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:07 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Volume volume-3f52f5fb-96de-408a-b0ed-6239ca00413d (3f52f5fb-96de-408a-b0ed-6239ca00413d): created successfully Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d7a9e2-d9c5-4888-8142-3f5fc8dc93a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Flow 'volume_create_manager' (33aa2cd7-3d8c-4774-a426-064a76df712a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5cb43181-b23f-4632-9951-6f27382e4b28 tempest-VolumesTransfersV355Test-1048509260 None] Created volume successfully. Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Acquiring lock "cinder-b7e171ce-20f9-4a12-adf6-5d937c8c4165-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-b7e171ce-20f9-4a12-adf6-5d937c8c4165-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Acquiring lock "cinder-quobyte-b7e171ce-20f9-4a12-adf6-5d937c8c4165" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-quobyte-b7e171ce-20f9-4a12-adf6-5d937c8c4165" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ad9361-8dd3-422d-8b8a-a23b2d3131f1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:07 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 Nov 01 08:55:07 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:08 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165" returned: 0 in 0.397s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:08 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165 Nov 01 08:55:08 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Acquiring lock "cinder-3f52f5fb-96de-408a-b0ed-6239ca00413d-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-3f52f5fb-96de-408a-b0ed-6239ca00413d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Acquiring lock "cinder-quobyte-3f52f5fb-96de-408a-b0ed-6239ca00413d" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-quobyte-3f52f5fb-96de-408a-b0ed-6239ca00413d" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e63194-3f41-4d68-9d87-0485107b1d18]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:08 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d Nov 01 08:55:08 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:08 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b7e171ce-20f9-4a12-adf6-5d937c8c4165" returned: 0 in 0.371s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-quobyte-b7e171ce-20f9-4a12-adf6-5d937c8c4165" released by "delete_volume" :: held 0.817s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Created reservations ['68b981bc-ecb5-4df0-9645-7a7b7ed33723', '211b4fe3-3582-4345-a385-f7216f114ac6', '54e894cc-2c2e-4021-8928-b3410fedbb74', '83125de8-1f94-486a-baa8-737062cd5029'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:08 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:08 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:08 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d" returned: 0 in 0.480s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:08 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d Nov 01 08:55:08 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:08 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.340s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Deleted volume successfully. Nov 01 08:55:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-348c68b7-cb44-49c3-9cbb-14e612570959 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-b7e171ce-20f9-4a12-adf6-5d937c8c4165-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:08 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3f52f5fb-96de-408a-b0ed-6239ca00413d" returned: 0 in 0.326s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-quobyte-3f52f5fb-96de-408a-b0ed-6239ca00413d" released by "delete_volume" :: held 0.868s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Created reservations ['ad8bc5be-1eb6-489f-b054-1708f18050bf', '5679775b-2e53-4aae-8fd1-b28a179b8a8d', '96c57aae-b01d-4b20-b76d-c21d8e6fe34b', '026b203c-5120-4210-9a7b-3472706d9529'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:09 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:09 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Flow 'volume_create_manager' (81a4a891-284a-43a9-afa0-409124d1cae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188472f-7fd9-4cb8-8213-042600f4137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4188472f-7fd9-4cb8-8213-042600f4137e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1210680344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0689ba-0081-448c-993e-995475614057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4976f36ba1488a9d5f6aab833a7cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:09Z,use_quota=True,user_id='6ad991ec0c614c1a900f45a31b80e83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c97b602-93af-41f0-94af-2a793ed1aaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c97b602-93af-41f0-94af-2a793ed1aaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecadea2-e590-4ce3-87e6-6297dc90d5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecadea2-e590-4ce3-87e6-6297dc90d5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0689ba-0081-448c-993e-995475614057', 'volume_name': 'volume-5a0689ba-0081-448c-993e-995475614057', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120f5acd-fc5c-4a5f-9ec7-13d281ab8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120f5acd-fc5c-4a5f-9ec7-13d281ab8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac41406-41a5-4af4-9137-e568327b5398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:09 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Volume 5a0689ba-0081-448c-993e-995475614057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0689ba-0081-448c-993e-995475614057', 'volume_size': 1} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1210680344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0689ba-0081-448c-993e-995475614057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe4976f36ba1488a9d5f6aab833a7cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:09Z,use_quota=True,user_id='6ad991ec0c614c1a900f45a31b80e83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Creating volume 5a0689ba-0081-448c-993e-995475614057 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:09 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:09 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.377s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Deleted volume successfully. Nov 01 08:55:09 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 1073741824 Nov 01 08:55:09 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f688cdd9-6ca2-4541-b150-c4fd05a5a4a5 tempest-VolumesTransfersV355Test-191811340 None] Lock "cinder-3f52f5fb-96de-408a-b0ed-6239ca00413d-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:10 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 1073741824" returned: 0 in 0.605s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:10 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 Nov 01 08:55:10 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:10 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057" returned: 0 in 0.378s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac41406-41a5-4af4-9137-e568327b5398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0689ba-0081-448c-993e-995475614057', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7a529-af07-44c9-ac25-3b13601e1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:10 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Volume volume-5a0689ba-0081-448c-993e-995475614057 (5a0689ba-0081-448c-993e-995475614057): created successfully Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7a529-af07-44c9-ac25-3b13601e1be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Flow 'volume_create_manager' (81a4a891-284a-43a9-afa0-409124d1cae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f9b1a4ae-5533-4d51-88b9-9b59171b8003 tempest-VolumesTransfersV357Test-882343744 None] Created volume successfully. Nov 01 08:55:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Acquiring lock "cinder-5a0689ba-0081-448c-993e-995475614057-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-5a0689ba-0081-448c-993e-995475614057-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Acquiring lock "cinder-quobyte-5a0689ba-0081-448c-993e-995475614057" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-quobyte-5a0689ba-0081-448c-993e-995475614057" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad583fc-bce2-444c-bba0-8e0a1fc719f4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:12 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 Nov 01 08:55:12 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:12 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057" returned: 0 in 0.496s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:12 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057 Nov 01 08:55:12 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:12 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a0689ba-0081-448c-993e-995475614057" returned: 0 in 0.301s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-quobyte-5a0689ba-0081-448c-993e-995475614057" released by "delete_volume" :: held 0.860s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Created reservations ['9349f890-176b-465f-abc6-38ab8196256a', '2cad141c-a683-4c68-9bbf-d59fc12edb96', '079ac3bf-ccb5-4404-b158-3bae0d9908f7', '0d7e2e64-ac4b-4931-90f0-8016c82cbd3d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:13 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:13 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:13 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:13 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Deleted volume successfully. Nov 01 08:55:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec9a57ab-a597-4843-bfb7-9f667d080e69 tempest-VolumesTransfersV357Test-856772389 None] Lock "cinder-5a0689ba-0081-448c-993e-995475614057-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Flow 'volume_create_manager' (8cc3ed71-4b6e-4a74-b095-9323ba559739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688618f8-52aa-487d-a25c-3e006567cc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688618f8-52aa-487d-a25c-3e006567cc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1028615353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a33cba-40c8-4c2e-946c-b024ad7b75c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3b2b02c1f348e698e4eb16e1c1cea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:19Z,use_quota=True,user_id='4087a707fc1a425ab0ea99cae71e0c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcde46f-6ea4-4300-b203-975904424334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcde46f-6ea4-4300-b203-975904424334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb10da60-d2f7-431e-8d0c-c2bdd34f0c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 08:55:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-aba5deda-f46e-4800-bc2f-6579fbd616bb req-2c010336-af0f-4b6b-b0a3-498ef9d925f4 tempest-ServerActionsTestOtherA-250974556 None] Terminate volume connection completed successfully. Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-aba5deda-f46e-4800-bc2f-6579fbd616bb req-2c010336-af0f-4b6b-b0a3-498ef9d925f4 tempest-ServerActionsTestOtherA-250974556 None] Deleting attachment ca0f40b1-2c20-46be-aa87-872607dc90a1. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb10da60-d2f7-431e-8d0c-c2bdd34f0c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73a33cba-40c8-4c2e-946c-b024ad7b75c4', 'volume_name': 'volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfbe18f-708e-4db7-a808-fa68d18a18f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfbe18f-708e-4db7-a808-fa68d18a18f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d01f16-fda9-4eef-a0ea-fc24439a98bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:19 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Volume 73a33cba-40c8-4c2e-946c-b024ad7b75c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 08:55:19 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Trying to clone 73a33cba-40c8-4c2e-946c-b024ad7b75c4 from image 2972c011-c2ff-40ad-8107-682efa81840b at location (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 08:55:20 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 08:55:20 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Image download 20.69 MB at 20.69 MB/s Nov 01 08:55:20 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a9f655-1b1e-4b99-92d7-51c2bbf96691]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:20 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD Nov 01 08:55:20 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:20 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:20 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b is fetched for user 4087a707fc1a425ab0ea99cae71e0c6c. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf656ee2-408a-4128-a420-a43a42cc31aa]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:21 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD Nov 01 08:55:21 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:21 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:21 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:21 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1028615353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a33cba-40c8-4c2e-946c-b024ad7b75c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3b2b02c1f348e698e4eb16e1c1cea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:19Z,use_quota=True,user_id='4087a707fc1a425ab0ea99cae71e0c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Creating volume 73a33cba-40c8-4c2e-946c-b024ad7b75c4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:21 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:21 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 1073741824 Nov 01 08:55:21 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:21 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.576s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:55:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:55:22 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 1073741824" returned: 0 in 0.778s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:22 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 Nov 01 08:55:22 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:22 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4" returned: 0 in 0.321s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Attempting download of 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume 73a33cba-40c8-4c2e-946c-b024ad7b75c4. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8bbd98-b646-4c30-9915-8c952b18940e]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_2uz1bc4b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:23 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_2uz1bc4b Nov 01 08:55:23 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:23 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_2uz1bc4b" returned: 0 in 0.409s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_2uz1bc4b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:23 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_2uz1bc4b Nov 01 08:55:23 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Flow 'volume_create_manager' (f715bf94-7c1c-45ab-8348-a59d24a1794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5475986a-de9b-469a-9a1a-2565b973f996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5475986a-de9b-469a-9a1a-2565b973f996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1536351795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aabc3f8-1729-4d9d-90bb-340937ad4306,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2acac62133f45c397b79b94b31e44bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:24Z,use_quota=True,user_id='d9c21489affa498eb7509f27c2cd73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4a29b9-783d-493f-9b22-0b2776e32b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4a29b9-783d-493f-9b22-0b2776e32b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7400e36-d992-42f8-9e8e-cbbb7214727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7400e36-d992-42f8-9e8e-cbbb7214727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aabc3f8-1729-4d9d-90bb-340937ad4306', 'volume_name': 'volume-6aabc3f8-1729-4d9d-90bb-340937ad4306', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f370be96-7981-41fd-88c3-ba929743aa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f370be96-7981-41fd-88c3-ba929743aa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968c8fb5-0507-43b7-a703-80681ad8a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:23 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Volume 6aabc3f8-1729-4d9d-90bb-340937ad4306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aabc3f8-1729-4d9d-90bb-340937ad4306', 'volume_size': 1} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1536351795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aabc3f8-1729-4d9d-90bb-340937ad4306,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2acac62133f45c397b79b94b31e44bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:24Z,use_quota=True,user_id='d9c21489affa498eb7509f27c2cd73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Creating volume 6aabc3f8-1729-4d9d-90bb-340937ad4306 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:23 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:23 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 1073741824 Nov 01 08:55:23 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:23 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_2uz1bc4b" returned: 1 in 0.589s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_2uz1bc4b' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7b18ff-8135-42eb-b814-b8422966cbd9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:24 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD Nov 01 08:55:24 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:24 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] 2972c011-c2ff-40ad-8107-682efa81840b was qcow2, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:24 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 Nov 01 08:55:24 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:24 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 1073741824" returned: 0 in 0.655s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:24 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 Nov 01 08:55:24 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:24 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306" returned: 0 in 0.456s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968c8fb5-0507-43b7-a703-80681ad8a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aabc3f8-1729-4d9d-90bb-340937ad4306', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cedb8d3-dd52-4331-a3c2-8c0803abfef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Volume volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 (6aabc3f8-1729-4d9d-90bb-340937ad4306): created successfully Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cedb8d3-dd52-4331-a3c2-8c0803abfef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Flow 'volume_create_manager' (f715bf94-7c1c-45ab-8348-a59d24a1794a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6477455e-1917-4c35-8ab6-7371ab6aea9f tempest-VolumesListTestJSON-1220636490 None] Created volume successfully. Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Flow 'volume_create_manager' (ab31bae3-b844-48cf-8c77-04755bf14f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf9c66c-998f-4a59-84ad-8e9fa06c7749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf9c66c-998f-4a59-84ad-8e9fa06c7749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-852481539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671db5c2-07a3-44e2-a580-09abf0340204,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2acac62133f45c397b79b94b31e44bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:27Z,use_quota=True,user_id='d9c21489affa498eb7509f27c2cd73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76ffcfa-008a-4f82-b891-fb327cb0240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d76ffcfa-008a-4f82-b891-fb327cb0240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1f3815-e105-403f-9d36-51604fda7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1f3815-e105-403f-9d36-51604fda7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671db5c2-07a3-44e2-a580-09abf0340204', 'volume_name': 'volume-671db5c2-07a3-44e2-a580-09abf0340204', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb489b68-7d69-4ef3-82d9-ba8b467bcf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb489b68-7d69-4ef3-82d9-ba8b467bcf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b60f9dd-f8db-4e92-8112-1263df581f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Volume 671db5c2-07a3-44e2-a580-09abf0340204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671db5c2-07a3-44e2-a580-09abf0340204', 'volume_size': 1} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-852481539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671db5c2-07a3-44e2-a580-09abf0340204,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2acac62133f45c397b79b94b31e44bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:27Z,use_quota=True,user_id='d9c21489affa498eb7509f27c2cd73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Creating volume 671db5c2-07a3-44e2-a580-09abf0340204 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:26 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:26 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 1073741824 Nov 01 08:55:26 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:27 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4" returned: 0 in 2.895s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_igfp2mvjdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:55:27 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Converted 112.00 MB image at 38.68 MB/s Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:27 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 1G Nov 01 08:55:27 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:27 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 1073741824" returned: 0 in 0.676s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Flow 'volume_create_manager' (8015defd-15e2-4b5a-9b99-8774b37058b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f99bd4-5458-4588-bb56-9e37a06bf7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f99bd4-5458-4588-bb56-9e37a06bf7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1110539429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049e88ab-c867-48b4-adb9-57fb4d76429b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bae154f78142b8a299a7d72fa06d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:27Z,use_quota=True,user_id='7d5e910cb8274bb9a279c302d4b68387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f9a461-9868-4963-84a3-0ecd1cbd74d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f9a461-9868-4963-84a3-0ecd1cbd74d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dca3f8-25fc-47a5-8f22-c83cc5527df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:27 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 Nov 01 08:55:27 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:27 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 1G" returned: 0 in 0.479s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Downloaded image 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume 73a33cba-40c8-4c2e-946c-b024ad7b75c4 successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b for user 4087a707fc1a425ab0ea99cae71e0c6c is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Marking volume 73a33cba-40c8-4c2e-946c-b024ad7b75c4 as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Copying metadata from image 2972c011-c2ff-40ad-8107-682efa81840b to 73a33cba-40c8-4c2e-946c-b024ad7b75c4. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Creating volume glance metadata for volume 73a33cba-40c8-4c2e-946c-b024ad7b75c4 backed by image 2972c011-c2ff-40ad-8107-682efa81840b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d01f16-fda9-4eef-a0ea-fc24439a98bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67302962-c225-406e-a633-11e1e829fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:27 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Volume volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 (73a33cba-40c8-4c2e-946c-b024ad7b75c4): created successfully Nov 01 08:55:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67302962-c225-406e-a633-11e1e829fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Flow 'volume_create_manager' (8cc3ed71-4b6e-4a74-b095-9323ba559739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204" returned: 0 in 0.419s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b60f9dd-f8db-4e92-8112-1263df581f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671db5c2-07a3-44e2-a580-09abf0340204', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d4c05b-855a-4c76-8fbf-9108ab47b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-244ac719-8bd0-49e1-9dff-fea237f6579a tempest-VolumesExtendTest-874369786 None] Created volume successfully. Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dca3f8-25fc-47a5-8f22-c83cc5527df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '049e88ab-c867-48b4-adb9-57fb4d76429b', 'volume_name': 'volume-049e88ab-c867-48b4-adb9-57fb4d76429b', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2324a2-c019-4329-89d9-ff992d531fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2324a2-c019-4329-89d9-ff992d531fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf32584f-abce-4800-b79c-0739fec61cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Volume 049e88ab-c867-48b4-adb9-57fb4d76429b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-049e88ab-c867-48b4-adb9-57fb4d76429b', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Trying to clone 049e88ab-c867-48b4-adb9-57fb4d76429b from image 2972c011-c2ff-40ad-8107-682efa81840b at location (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 08:55:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Volume volume-671db5c2-07a3-44e2-a580-09abf0340204 (671db5c2-07a3-44e2-a580-09abf0340204): created successfully Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d4c05b-855a-4c76-8fbf-9108ab47b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Flow 'volume_create_manager' (ab31bae3-b844-48cf-8c77-04755bf14f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-af507a6a-be23-4d21-a161-c47b23c63f5d tempest-VolumesListTestJSON-1220636490 None] Created volume successfully. Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 08:55:28 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Image download 20.69 MB at 20.69 MB/s Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[323f2cbb-ebf6-4980-b143-6dbff96cf4d3]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:29 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD Nov 01 08:55:29 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7b823-9d53-4a0a-a467-408fd4cfb4c1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:29 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD" returned: 0 in 0.644s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b is fetched for user 7d5e910cb8274bb9a279c302d4b68387. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7484a43-2894-44ce-a563-b5e3390296bb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:29 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 Nov 01 08:55:29 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Flow 'volume_create_manager' (bb2d186a-c385-4fe9-8832-f079314bd8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaadc5a-4fa3-4d84-890e-511d131acebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:29 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD Nov 01 08:55:29 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbaadc5a-4fa3-4d84-890e-511d131acebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2030567544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d99d74-995b-4f31-b990-c33e71459f19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2acac62133f45c397b79b94b31e44bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:30Z,use_quota=True,user_id='d9c21489affa498eb7509f27c2cd73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cd9bcc-f49f-4e44-be4c-12c72735537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cd9bcc-f49f-4e44-be4c-12c72735537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224a3d22-8c05-43a1-9d94-e9d0b069fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224a3d22-8c05-43a1-9d94-e9d0b069fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d99d74-995b-4f31-b990-c33e71459f19', 'volume_name': 'volume-63d99d74-995b-4f31-b990-c33e71459f19', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e226ba5b-5379-4044-b1b2-3decfc47d515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e226ba5b-5379-4044-b1b2-3decfc47d515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70810de5-3fad-41fa-bbbe-58412dbd4a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:29 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Volume 63d99d74-995b-4f31-b990-c33e71459f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d99d74-995b-4f31-b990-c33e71459f19', 'volume_size': 1} Nov 01 08:55:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:30 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4" returned: 0 in 0.738s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 2G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:30 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 2G" returned: 0 in 0.188s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2030567544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d99d74-995b-4f31-b990-c33e71459f19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2acac62133f45c397b79b94b31e44bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:30Z,use_quota=True,user_id='d9c21489affa498eb7509f27c2cd73a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Creating volume 63d99d74-995b-4f31-b990-c33e71459f19 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:30 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:30 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 1073741824 Nov 01 08:55:30 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3c63b669-2947-463a-9ee7-8c9792715d7c tempest-VolumesExtendTest-874369786 None] Extend volume completed successfully. Nov 01 08:55:30 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 1073741824" returned: 0 in 0.512s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Acquiring lock "cinder-73a33cba-40c8-4c2e-946c-b024ad7b75c4-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Lock "cinder-73a33cba-40c8-4c2e-946c-b024ad7b75c4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:31 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 Nov 01 08:55:31 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Acquiring lock "cinder-quobyte-73a33cba-40c8-4c2e-946c-b024ad7b75c4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-73a33cba-40c8-4c2e-946c-b024ad7b75c4" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aa104e-1b98-4720-9748-432f0842ebb4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:31 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19" returned: 0 in 0.330s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1110539429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049e88ab-c867-48b4-adb9-57fb4d76429b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bae154f78142b8a299a7d72fa06d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:27Z,use_quota=True,user_id='7d5e910cb8274bb9a279c302d4b68387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Creating volume 049e88ab-c867-48b4-adb9-57fb4d76429b {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:31 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:31 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:31 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70810de5-3fad-41fa-bbbe-58412dbd4a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d99d74-995b-4f31-b990-c33e71459f19', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbbdba-2dbc-4809-987a-cac5657d5990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:31 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b 1073741824 Nov 01 08:55:31 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Volume volume-63d99d74-995b-4f31-b990-c33e71459f19 (63d99d74-995b-4f31-b990-c33e71459f19): created successfully Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbbdba-2dbc-4809-987a-cac5657d5990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Flow 'volume_create_manager' (bb2d186a-c385-4fe9-8832-f079314bd8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-50361f5e-ee92-47fd-a93a-cf417d97614b tempest-VolumesListTestJSON-1220636490 None] Created volume successfully. Nov 01 08:55:31 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4" returned: 0 in 0.608s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:31 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4 Nov 01 08:55:31 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:32 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b 1073741824" returned: 0 in 0.669s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:32 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b Nov 01 08:55:32 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:32 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-73a33cba-40c8-4c2e-946c-b024ad7b75c4" returned: 0 in 0.498s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-73a33cba-40c8-4c2e-946c-b024ad7b75c4" released by "delete_volume" :: held 1.192s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Created reservations ['37544124-ccca-45c1-a7d1-9d956d91a3be', 'd064f1ec-0ca7-4c27-8511-cf4bc20d99ae', '7b47977b-9f9c-402b-862f-745e1d20e9e7', '8d8f68e3-c8ea-40a6-ae11-f7f54057f08b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:32 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b" returned: 0 in 0.543s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:32 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:32 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Attempting download of 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume 049e88ab-c867-48b4-adb9-57fb4d76429b. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb935dd-2b5e-4a5e-a9a5-4317e0a22c18]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_7z4iqhs5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:33 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_7z4iqhs5 Nov 01 08:55:33 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:33 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.550s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:33 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Deleted volume successfully. Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e6b59b4-d6be-45e0-8b02-878f9d07983e tempest-VolumesExtendTest-874369786 None] Lock "cinder-73a33cba-40c8-4c2e-946c-b024ad7b75c4-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:33 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_7z4iqhs5" returned: 0 in 0.492s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_7z4iqhs5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:33 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_7z4iqhs5 Nov 01 08:55:33 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:33 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_7z4iqhs5" returned: 1 in 0.550s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_7z4iqhs5' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7bfbf0-71cf-4a6e-ba64-cce24331b609]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:34 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD Nov 01 08:55:34 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Flow 'volume_create_manager' (3b1b42c1-09d9-4072-b8b3-21690969d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7ca712-b9f2-483c-aceb-5ef64d19c6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7ca712-b9f2-483c-aceb-5ef64d19c6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-449747364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a30cc6-1882-4249-a487-7eee6886ada1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3b2b02c1f348e698e4eb16e1c1cea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:34Z,use_quota=True,user_id='4087a707fc1a425ab0ea99cae71e0c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3651d6-64ea-4009-8d7e-702142e11a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3651d6-64ea-4009-8d7e-702142e11a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d92df-c619-4673-9dc0-b92cc6156c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d92df-c619-4673-9dc0-b92cc6156c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a30cc6-1882-4249-a487-7eee6886ada1', 'volume_name': 'volume-03a30cc6-1882-4249-a487-7eee6886ada1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2060e52b-bbee-4d4f-ba4b-1dd23f9da88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2060e52b-bbee-4d4f-ba4b-1dd23f9da88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497b13e3-8aa0-4780-86b8-1dc31603be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:34 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Volume 03a30cc6-1882-4249-a487-7eee6886ada1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a30cc6-1882-4249-a487-7eee6886ada1', 'volume_size': 1} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-449747364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a30cc6-1882-4249-a487-7eee6886ada1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3b2b02c1f348e698e4eb16e1c1cea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:34Z,use_quota=True,user_id='4087a707fc1a425ab0ea99cae71e0c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Creating volume 03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:34 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:34 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 1073741824 Nov 01 08:55:34 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:34 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] 2972c011-c2ff-40ad-8107-682efa81840b was qcow2, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 08:55:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:34 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b Nov 01 08:55:34 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:35 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 1073741824" returned: 0 in 0.684s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:35 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 Nov 01 08:55:35 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "cinder-63d99d74-995b-4f31-b990-c33e71459f19-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-63d99d74-995b-4f31-b990-c33e71459f19-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "cinder-quobyte-63d99d74-995b-4f31-b990-c33e71459f19" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-quobyte-63d99d74-995b-4f31-b990-c33e71459f19" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a511d01-c6b1-4953-a27e-fa5101cce54d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:35 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1" returned: 0 in 0.366s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:35 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 Nov 01 08:55:35 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497b13e3-8aa0-4780-86b8-1dc31603be1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a30cc6-1882-4249-a487-7eee6886ada1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c181a661-d1bb-4e1e-991c-e677031e4a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Volume volume-03a30cc6-1882-4249-a487-7eee6886ada1 (03a30cc6-1882-4249-a487-7eee6886ada1): created successfully Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c181a661-d1bb-4e1e-991c-e677031e4a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Flow 'volume_create_manager' (3b1b42c1-09d9-4072-b8b3-21690969d581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0c1a731f-e6f8-417c-9c0f-dd37435ea182 tempest-VolumesExtendTest-874369786 None] Created volume successfully. Nov 01 08:55:35 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19" returned: 0 in 0.503s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:35 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19 Nov 01 08:55:35 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:36 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-63d99d74-995b-4f31-b990-c33e71459f19" returned: 0 in 0.366s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-quobyte-63d99d74-995b-4f31-b990-c33e71459f19" released by "delete_volume" :: held 0.919s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Created reservations ['7200b49a-2d98-4b80-a97b-bdf22d5c489d', '4d9550d8-ff85-4b3c-bcb3-7caaf586c2a1', '943c4880-a513-4945-a8ca-a2763a9f3ae2', 'a9e8ceec-6c92-48ed-8bbe-954aa021fcb2'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:36 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:36 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Creating offline snapshot f4d21673-6534-4a99-bf5d-b1428b06ed1b of volume 03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b935b36-53d9-4c83-85be-478d52445076]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:36 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 Nov 01 08:55:36 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:36 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.345s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Deleted volume successfully. Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6d057198-769f-43c3-8809-b0872c73630e tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-63d99d74-995b-4f31-b990-c33e71459f19-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:36 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b" returned: 0 in 2.339s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_ijj2xtcadevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:55:36 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Converted 112.00 MB image at 47.87 MB/s Nov 01 08:55:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:37 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b 1G Nov 01 08:55:37 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:37 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1" returned: 0 in 0.490s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:37 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b 1G Nov 01 08:55:37 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:37 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b 1G" returned: 0 in 0.367s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Downloaded image 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume 049e88ab-c867-48b4-adb9-57fb4d76429b successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b for user 7d5e910cb8274bb9a279c302d4b68387 is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Marking volume 049e88ab-c867-48b4-adb9-57fb4d76429b as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Copying metadata from image 2972c011-c2ff-40ad-8107-682efa81840b to 049e88ab-c867-48b4-adb9-57fb4d76429b. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Creating volume glance metadata for volume 049e88ab-c867-48b4-adb9-57fb4d76429b backed by image 2972c011-c2ff-40ad-8107-682efa81840b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf32584f-abce-4800-b79c-0739fec61cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049e88ab-c867-48b4-adb9-57fb4d76429b', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f0b490-170b-4775-af84-60a232651e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:37 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Volume volume-049e88ab-c867-48b4-adb9-57fb4d76429b (049e88ab-c867-48b4-adb9-57fb4d76429b): created successfully Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f0b490-170b-4775-af84-60a232651e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Flow 'volume_create_manager' (8015defd-15e2-4b5a-9b99-8774b37058b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8e0edaf9-c04c-4df8-ba6d-5ef8d83787a9 tempest-ServerActionsTestOtherA-250974556 None] Created volume successfully. Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "cinder-671db5c2-07a3-44e2-a580-09abf0340204-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-671db5c2-07a3-44e2-a580-09abf0340204-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:37 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b 1G" returned: 0 in 0.525s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a30cc6-1882-4249-a487-7eee6886ada1 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:37 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a30cc6-1882-4249-a487-7eee6886ada1 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "cinder-quobyte-671db5c2-07a3-44e2-a580-09abf0340204" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:37 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-quobyte-671db5c2-07a3-44e2-a580-09abf0340204" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4923b54b-4e42-4211-9943-798e65efe95c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:37 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 Nov 01 08:55:37 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:38 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a30cc6-1882-4249-a487-7eee6886ada1 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b" returned: 0 in 0.331s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:38 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b is being set with open permissions: ugo+rw Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:38 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b Nov 01 08:55:38 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:38 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:38 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204 Nov 01 08:55:38 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:38 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b" returned: 0 in 0.271s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:38 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.info Nov 01 08:55:38 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:38 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-671db5c2-07a3-44e2-a580-09abf0340204" returned: 0 in 0.317s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-quobyte-671db5c2-07a3-44e2-a580-09abf0340204" released by "delete_volume" :: held 0.761s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Created reservations ['56a4d767-9492-45f6-a443-7c1fa9b90e94', 'cbdeeca5-a8f4-44c4-8795-cea42cbdf2ae', '254e76ea-4710-4813-b64f-527ee5b22e45', 'f4af84cc-2456-4067-a3dc-f6f5ad998ee1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=138,cinder:INSERT=51,cinder:UPDATE=144,cinder:DELETE=13 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=154,cinder:SELECT=124,cinder:DELETE=12,cinder:INSERT=46 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:55:38 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.info" returned: 0 in 0.381s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:38 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.info is being set with open permissions: ugo+rw Nov 01 08:55:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:38 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:38 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:38 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.info Nov 01 08:55:38 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "cinder-6aabc3f8-1729-4d9d-90bb-340937ad4306-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-6aabc3f8-1729-4d9d-90bb-340937ad4306-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "cinder-quobyte-6aabc3f8-1729-4d9d-90bb-340937ad4306" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-quobyte-6aabc3f8-1729-4d9d-90bb-340937ad4306" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb8a776-dddd-48f1-abd9-f12ee83013f6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:39 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.info" returned: 0 in 0.458s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:39 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.531s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Deleted volume successfully. Nov 01 08:55:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-643f34b0-9727-4567-a924-216e0e9b0f6e tempest-VolumesExtendTest-874369786 None] Create snapshot completed successfully Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c0ccbe9d-b58d-4622-8018-b9258a1822cf tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-671db5c2-07a3-44e2-a580-09abf0340204-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:39 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 Nov 01 08:55:39 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:39 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306" returned: 0 in 0.431s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:39 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306 Nov 01 08:55:39 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:40 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aabc3f8-1729-4d9d-90bb-340937ad4306" returned: 0 in 0.375s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-quobyte-6aabc3f8-1729-4d9d-90bb-340937ad4306" released by "delete_volume" :: held 0.898s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69fa7a8-ba45-4af6-bed3-71eede4538e6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Created reservations ['469cf92c-e069-4c47-84d3-a9cd88c0308c', '5eedf3b4-0142-4d72-b36f-731bf0483b1a', '9ea33a73-dc0e-4396-a096-d8769afde3ea', '7992ce92-7e26-4717-92ed-465cb92f5e0e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:40 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 Nov 01 08:55:40 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:40 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:40 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:40 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1" returned: 0 in 0.630s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b 2G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:40 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.585s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:40 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Deleted volume successfully. Nov 01 08:55:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f8dd6499-3456-4626-bf81-3731264807e6 tempest-VolumesListTestJSON-1220636490 None] Lock "cinder-6aabc3f8-1729-4d9d-90bb-340937ad4306-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b 2G" returned: 0 in 0.245s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.938s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-96052c7d-094d-4bc4-b669-4e9b6fc4a67f tempest-VolumesExtendTest-874369786 None] Extend volume completed successfully. Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Acquiring lock "cinder-f4d21673-6534-4a99-bf5d-b1428b06ed1b-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Lock "cinder-f4d21673-6534-4a99-bf5d-b1428b06ed1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Acquiring lock "cinder-quobyte-03a30cc6-1882-4249-a487-7eee6886ada1" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-03a30cc6-1882-4249-a487-7eee6886ada1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Acquiring lock "cinder-quobyte-f4d21673-6534-4a99-bf5d-b1428b06ed1b" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-f4d21673-6534-4a99-bf5d-b1428b06ed1b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Deleting offline snapshot f4d21673-6534-4a99-bf5d-b1428b06ed1b of volume 03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] snapshot_file for this snap is: volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aecaaea-d86e-4983-b248-782a6d4f0f2a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:41 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b Nov 01 08:55:41 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:42 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b" returned: 0 in 0.617s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03a30cc6-1882-4249-a487-7eee6886ada1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b950ea-2559-437c-958b-4491ab320c06]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:42 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 Nov 01 08:55:42 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-a8559119-714e-470a-b9ba-a9104b4e5203 req-dd80f41a-799f-4e12-94fb-4be9b55cb4bb tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-a8559119-714e-470a-b9ba-a9104b4e5203 req-dd80f41a-799f-4e12-94fb-4be9b55cb4bb tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-a8559119-714e-470a-b9ba-a9104b4e5203 req-dd80f41a-799f-4e12-94fb-4be9b55cb4bb tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-a8559119-714e-470a-b9ba-a9104b4e5203 req-dd80f41a-799f-4e12-94fb-4be9b55cb4bb tempest-ServerActionsTestOtherA-250974556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-049e88ab-c867-48b4-adb9-57fb4d76429b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a08b1985-7afe-4d42-947b-79b682d9eb08', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:55:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-a8559119-714e-470a-b9ba-a9104b4e5203 req-dd80f41a-799f-4e12-94fb-4be9b55cb4bb tempest-ServerActionsTestOtherA-250974556 None] attachment_update completed successfully. Nov 01 08:55:43 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1" returned: 0 in 0.769s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:43 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b Nov 01 08:55:43 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:43 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b" returned: 0 in 0.686s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:43 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b Nov 01 08:55:43 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:44 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1.f4d21673-6534-4a99-bf5d-b1428b06ed1b" returned: 0 in 0.306s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-f4d21673-6534-4a99-bf5d-b1428b06ed1b" released by "_delete_snapshot" :: held 2.557s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-03a30cc6-1882-4249-a487-7eee6886ada1" released by "delete_snapshot" :: held 2.585s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Created reservations ['62b0d2be-49b7-4ee0-8a6d-2d47c9086ba1', '2a6cca9b-df69-4edf-b033-06e7aad0b9e5', 'a3679f75-4774-4d38-9aad-32a1e0a231c7', '2b952d3e-bb2e-45eb-9be3-162521cb4dbb'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Delete snapshot completed successfully. Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-50727e94-a0b8-4db2-8e3e-70f75b51a9d3 tempest-VolumesExtendTest-874369786 None] Lock "cinder-f4d21673-6534-4a99-bf5d-b1428b06ed1b-delete_snapshot" released by "delete_snapshot" :: held 2.812s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Acquiring lock "cinder-03a30cc6-1882-4249-a487-7eee6886ada1-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Lock "cinder-03a30cc6-1882-4249-a487-7eee6886ada1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Acquiring lock "cinder-quobyte-03a30cc6-1882-4249-a487-7eee6886ada1" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:55:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-03a30cc6-1882-4249-a487-7eee6886ada1" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:55:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf82bd-c879-4f4c-b62a-7544ef80fb32]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:55:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:45 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 Nov 01 08:55:45 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:45 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1" returned: 0 in 0.535s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:45 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1 Nov 01 08:55:45 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:45 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-03a30cc6-1882-4249-a487-7eee6886ada1" returned: 0 in 0.385s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Lock "cinder-quobyte-03a30cc6-1882-4249-a487-7eee6886ada1" released by "delete_volume" :: held 1.049s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Created reservations ['be559dca-3ddf-42b3-8795-507cd1503086', '32c00c6d-d1f9-468b-8853-a980519fa9aa', 'b3eb5d25-9644-4ce8-9d37-59e6512218ed', '4e6bb3be-eb35-43a3-9013-1ac3ad5622ee'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:46 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:55:46 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Flow 'volume_create_manager' (0899c969-aa8b-42c5-951b-6c757f9b2b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa377b7b-c72f-43d2-892c-bee86886e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa377b7b-c72f-43d2-892c-bee86886e183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-699754573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67458017-10d4-4d1c-90b3-a4990e300ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041f7ff84cc14708ae3d05c1dbc0a894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:46Z,use_quota=True,user_id='3ee4257ed7f84f6dafb9a43517dabaa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f311221-c077-48cd-bb2f-fdb969efc141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f311221-c077-48cd-bb2f-fdb969efc141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da669e1-1d9a-4443-bcb4-9ab526723eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da669e1-1d9a-4443-bcb4-9ab526723eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67458017-10d4-4d1c-90b3-a4990e300ea2', 'volume_name': 'volume-67458017-10d4-4d1c-90b3-a4990e300ea2', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4543f1d3-84ef-4848-a2a2-f766076abdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4543f1d3-84ef-4848-a2a2-f766076abdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7834986-cfff-43ab-bc07-4e3ab27901de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:46 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Volume 67458017-10d4-4d1c-90b3-a4990e300ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67458017-10d4-4d1c-90b3-a4990e300ea2', 'volume_size': 1} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-699754573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67458017-10d4-4d1c-90b3-a4990e300ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041f7ff84cc14708ae3d05c1dbc0a894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:46Z,use_quota=True,user_id='3ee4257ed7f84f6dafb9a43517dabaa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Creating volume 67458017-10d4-4d1c-90b3-a4990e300ea2 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:46 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:46 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.544s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:55:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Deleted volume successfully. Nov 01 08:55:46 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 1073741824 Nov 01 08:55:46 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1bffb7de-24c1-4e42-9e0b-060ace32aa8d tempest-VolumesExtendTest-874369786 None] Lock "cinder-03a30cc6-1882-4249-a487-7eee6886ada1-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:55:47 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 1073741824" returned: 0 in 0.714s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:47 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 Nov 01 08:55:47 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:47 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2" returned: 0 in 0.284s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7834986-cfff-43ab-bc07-4e3ab27901de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67458017-10d4-4d1c-90b3-a4990e300ea2', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fb5c0d-b3be-4ff5-8693-c5a33214f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:47 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Volume volume-67458017-10d4-4d1c-90b3-a4990e300ea2 (67458017-10d4-4d1c-90b3-a4990e300ea2): created successfully Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fb5c0d-b3be-4ff5-8693-c5a33214f011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Flow 'volume_create_manager' (0899c969-aa8b-42c5-951b-6c757f9b2b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c9c4e61b-65ab-40ce-80f3-1dd92a242858 tempest-VolumesNegativeTest-932318110 None] Created volume successfully. Nov 01 08:55:54 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Flow 'volume_create_manager' (bfb5a0a8-6dc1-4ff0-b3a1-4bd14db032b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5644eb-99c4-4e31-a327-d80366d79e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5644eb-99c4-4e31-a327-d80366d79e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-830552965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f87a50c60354e91b1cd6523d024c7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:55Z,use_quota=True,user_id='0daf7cca32f04a84864a737e03ef3129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da031a25-9776-4eea-a507-1367b6a6456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da031a25-9776-4eea-a507-1367b6a6456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9127c539-9041-41dc-8600-1496ed4428d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9127c539-9041-41dc-8600-1496ed4428d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a', 'volume_name': 'volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dd59e4-06cf-4ebb-b4e1-53e9875f8370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dd59e4-06cf-4ebb-b4e1-53e9875f8370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f304f63e-75b3-4b33-99f4-2b59b294ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:55 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Volume e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a', 'volume_size': 1} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-830552965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f87a50c60354e91b1cd6523d024c7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:55:55Z,use_quota=True,user_id='0daf7cca32f04a84864a737e03ef3129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Creating volume e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:55:55 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:55:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:55 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a 1073741824 Nov 01 08:55:55 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:56 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a 1073741824" returned: 0 in 1.070s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:55:56 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a Nov 01 08:55:56 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:55:56 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a" returned: 0 in 0.511s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f304f63e-75b3-4b33-99f4-2b59b294ba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda88619-df59-4c77-bff2-a07108ac0cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:55:56 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Volume volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a (e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a): created successfully Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda88619-df59-4c77-bff2-a07108ac0cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:55:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Flow 'volume_create_manager' (bfb5a0a8-6dc1-4ff0-b3a1-4bd14db032b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:55:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ecaf2dd5-e071-44f7-a9c9-19423479e557 tempest-AttachVolumeShelveTestJSON-1670389575 None] Created volume successfully. Nov 01 08:56:06 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=35,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:56:06 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=47,cinder:SELECT=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:56:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-696c5946-5e4c-453a-8987-e198f63ae9e6 req-2d026813-ff02-491d-bfce-b7854db23a4d tempest-ServerActionsTestOtherA-250974556 None] Terminate volume connection completed successfully. Nov 01 08:56:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-696c5946-5e4c-453a-8987-e198f63ae9e6 req-2d026813-ff02-491d-bfce-b7854db23a4d tempest-ServerActionsTestOtherA-250974556 None] Deleting attachment a08b1985-7afe-4d42-947b-79b682d9eb08. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:56:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-696c5946-5e4c-453a-8987-e198f63ae9e6 req-33b62db9-5d50-4c5b-9b67-c6435af3c755 tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-696c5946-5e4c-453a-8987-e198f63ae9e6 req-33b62db9-5d50-4c5b-9b67-c6435af3c755 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-696c5946-5e4c-453a-8987-e198f63ae9e6 req-33b62db9-5d50-4c5b-9b67-c6435af3c755 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-696c5946-5e4c-453a-8987-e198f63ae9e6 req-33b62db9-5d50-4c5b-9b67-c6435af3c755 tempest-ServerActionsTestOtherA-250974556 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-049e88ab-c867-48b4-adb9-57fb4d76429b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '134612d0-2895-4861-9611-ce465a4e558d', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:56:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-696c5946-5e4c-453a-8987-e198f63ae9e6 req-33b62db9-5d50-4c5b-9b67-c6435af3c755 tempest-ServerActionsTestOtherA-250974556 None] attachment_update completed successfully. Nov 01 08:56:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-b9e0516b-79df-4ae7-8cb0-0fecf8ce4b2d req-5a90cd46-7ded-4ac3-9f9d-582c400f33ff tempest-AttachVolumeShelveTestJSON-1670389575 None] No connector for attachment cd136211-0f6d-44ca-8650-a28f635646a3; skipping storage backend terminate_connection call. {{(pid=86770) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 01 08:56:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-b9e0516b-79df-4ae7-8cb0-0fecf8ce4b2d req-5a90cd46-7ded-4ac3-9f9d-582c400f33ff tempest-AttachVolumeShelveTestJSON-1670389575 None] Deleting attachment cd136211-0f6d-44ca-8650-a28f635646a3. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:21 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:56:21 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:21 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (13ba3cb4-b9e4-4d3e-b306-def2fd771a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19669859-6499-4a1f-9027-ae16528b3d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19669859-6499-4a1f-9027-ae16528b3d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1895679819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a188605d-14bd-4a68-a399-d7dd7473bdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:56:22Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155ee136-97f4-4477-bd55-8c28bbad6a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155ee136-97f4-4477-bd55-8c28bbad6a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53391aa5-3b57-4061-9ab4-e6b57d4f0efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53391aa5-3b57-4061-9ab4-e6b57d4f0efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a188605d-14bd-4a68-a399-d7dd7473bdba', 'volume_name': 'volume-a188605d-14bd-4a68-a399-d7dd7473bdba', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f535b16-4fa9-4c98-93e8-74a3d3b1a1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f535b16-4fa9-4c98-93e8-74a3d3b1a1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0c4ab2-63cf-4b0a-bc66-b60f7dd5d8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:22 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Volume a188605d-14bd-4a68-a399-d7dd7473bdba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a188605d-14bd-4a68-a399-d7dd7473bdba', 'volume_size': 1} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1895679819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a188605d-14bd-4a68-a399-d7dd7473bdba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:56:22Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Creating volume a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:22 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:56:22 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.942s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:56:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:56:22 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba 1073741824 Nov 01 08:56:22 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Acquiring lock "cinder-67458017-10d4-4d1c-90b3-a4990e300ea2-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Lock "cinder-67458017-10d4-4d1c-90b3-a4990e300ea2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:23 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba 1073741824" returned: 0 in 1.134s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Acquiring lock "cinder-quobyte-67458017-10d4-4d1c-90b3-a4990e300ea2" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Lock "cinder-quobyte-67458017-10d4-4d1c-90b3-a4990e300ea2" acquired by "delete_volume" :: waited 0.042s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab55eb4-fac5-4997-9958-49ed3e6be9ee]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:23 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba Nov 01 08:56:23 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:23 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 Nov 01 08:56:23 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:24 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba" returned: 0 in 0.571s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0c4ab2-63cf-4b0a-bc66-b60f7dd5d8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a188605d-14bd-4a68-a399-d7dd7473bdba', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1899268a-57cf-46d1-ab94-798d1356be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:24 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2" returned: 0 in 0.647s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Volume volume-a188605d-14bd-4a68-a399-d7dd7473bdba (a188605d-14bd-4a68-a399-d7dd7473bdba): created successfully Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1899268a-57cf-46d1-ab94-798d1356be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (13ba3cb4-b9e4-4d3e-b306-def2fd771a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:56:24 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2 Nov 01 08:56:24 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-bb53c62b-d216-4a55-8497-443dc321b510 tempest-VolumesSnapshotTestJSON-1001531051 None] Created volume successfully. Nov 01 08:56:24 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-67458017-10d4-4d1c-90b3-a4990e300ea2" returned: 0 in 0.606s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Lock "cinder-quobyte-67458017-10d4-4d1c-90b3-a4990e300ea2" released by "delete_volume" :: held 1.358s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:24 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Created reservations ['244d03a9-a465-431a-9944-909bfa577d34', '4798cc85-2ba9-4a64-8c75-fd8e9005f379', '4d2a676f-66ce-4a76-b424-c3dea6bfd3ab', '7ef7e94c-3ad4-4fd0-a0f1-200c390d3a8c'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:25 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:56:25 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:25 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.543s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:56:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Deleted volume successfully. Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c342cdce-78fe-44a4-98f8-6c959f20c640 tempest-VolumesNegativeTest-932318110 None] Lock "cinder-67458017-10d4-4d1c-90b3-a4990e300ea2-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Creating offline snapshot 7b42858a-3e30-4d8a-a8b6-6821748d649e of volume a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3ffdf-e8d2-46a1-9c8e-e27c77b3c1c6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:26 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba Nov 01 08:56:26 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:26 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba" returned: 0 in 0.703s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:26 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e 1G Nov 01 08:56:26 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:27 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e 1G" returned: 0 in 0.898s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a188605d-14bd-4a68-a399-d7dd7473bdba -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:27 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a188605d-14bd-4a68-a399-d7dd7473bdba -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e Nov 01 08:56:27 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:28 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a188605d-14bd-4a68-a399-d7dd7473bdba -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e" returned: 0 in 0.639s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:28 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e is being set with open permissions: ugo+rw Nov 01 08:56:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:28 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e Nov 01 08:56:28 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:28 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e" returned: 0 in 0.338s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:28 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.info Nov 01 08:56:28 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:28 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.info" returned: 0 in 0.298s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:28 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.info is being set with open permissions: ugo+rw Nov 01 08:56:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:28 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.info Nov 01 08:56:28 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:29 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.info" returned: 0 in 0.328s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.369s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:29 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-18beb324-d607-47fd-9ad0-d1bc9e7f9c0d tempest-VolumesSnapshotTestJSON-1001531051 None] Create snapshot completed successfully Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-7b42858a-3e30-4d8a-a8b6-6821748d649e-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-7b42858a-3e30-4d8a-a8b6-6821748d649e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-a188605d-14bd-4a68-a399-d7dd7473bdba" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-a188605d-14bd-4a68-a399-d7dd7473bdba" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-7b42858a-3e30-4d8a-a8b6-6821748d649e" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-7b42858a-3e30-4d8a-a8b6-6821748d649e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Deleting offline snapshot 7b42858a-3e30-4d8a-a8b6-6821748d649e of volume a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] snapshot_file for this snap is: volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[95add81f-45a1-4c34-a08f-7d7c836f1a42]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:30 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e Nov 01 08:56:30 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:31 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e" returned: 0 in 0.606s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a188605d-14bd-4a68-a399-d7dd7473bdba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:56:31 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0029020a-2cb2-4689-b32b-7b26437323d9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:31 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba Nov 01 08:56:31 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:31 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba" returned: 0 in 0.545s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:31 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e Nov 01 08:56:31 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e" returned: 0 in 0.577s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:32 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:32 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e Nov 01 08:56:32 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:32 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba.7b42858a-3e30-4d8a-a8b6-6821748d649e" returned: 0 in 0.525s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-7b42858a-3e30-4d8a-a8b6-6821748d649e" released by "_delete_snapshot" :: held 2.463s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-a188605d-14bd-4a68-a399-d7dd7473bdba" released by "delete_snapshot" :: held 2.507s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:33 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['9a4130b6-80df-4dcd-ae73-121204010b3d', '11242930-2964-4952-8d41-ae89a4fd1b71', 'df600dc3-8ef0-41dd-a9d4-95de9185e241', '9b5fcb83-3673-4260-b828-b4c52d19ebe6'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:56:33 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Delete snapshot completed successfully. Nov 01 08:56:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9e3c075a-fe35-4297-b2b5-97227dcb146e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-7b42858a-3e30-4d8a-a8b6-6821748d649e-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:34 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:56:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (1f9c7d0a-925f-4612-bb51-e756599d1439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:56:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53c51e0-4ca8-42b3-af2b-6d58f9f80147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53c51e0-4ca8-42b3-af2b-6d58f9f80147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-634746147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf31ed5-8180-47f6-9a1e-b67f46fcac98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:56:35Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a15f35c-c83c-4a75-89fd-4617990b3ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a15f35c-c83c-4a75-89fd-4617990b3ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6149e56d-7861-4c96-b72f-25b929af4994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6149e56d-7861-4c96-b72f-25b929af4994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf31ed5-8180-47f6-9a1e-b67f46fcac98', 'volume_name': 'volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c012fd0-ef9f-4033-b19f-40e2712981d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c012fd0-ef9f-4033-b19f-40e2712981d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43c765-c6d2-45e3-91f5-6431efd4bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Volume 4cf31ed5-8180-47f6-9a1e-b67f46fcac98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98', 'volume_size': 1} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-634746147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf31ed5-8180-47f6-9a1e-b67f46fcac98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:56:35Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Creating volume 4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:56:35 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:35 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 1073741824 Nov 01 08:56:35 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:35 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 1073741824" returned: 0 in 0.872s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:36 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 Nov 01 08:56:36 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:36 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" returned: 0 in 0.409s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43c765-c6d2-45e3-91f5-6431efd4bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e324ae9e-2d2a-480c-b09c-77fe2ec910b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Volume volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 (4cf31ed5-8180-47f6-9a1e-b67f46fcac98): created successfully Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e324ae9e-2d2a-480c-b09c-77fe2ec910b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (1f9c7d0a-925f-4612-bb51-e756599d1439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:56:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-df0747c0-1d66-4b15-9e3c-0a092ccbe01e tempest-VolumesSnapshotTestJSON-1001531051 None] Created volume successfully. Nov 01 08:56:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Creating offline snapshot fec7bec4-461a-410b-b340-70893b0bb256 of volume 4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:56:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[81889e9e-bbb3-425a-8db9-7ab1f244652c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:37 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 Nov 01 08:56:37 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:37 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" returned: 0 in 0.382s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:37 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 1G Nov 01 08:56:37 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:38 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 1G" returned: 0 in 0.542s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:38 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 Nov 01 08:56:38 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:38 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:38 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 is being set with open permissions: ugo+rw Nov 01 08:56:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:38 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 Nov 01 08:56:38 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:38 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256" returned: 0 in 0.269s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:38 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.info Nov 01 08:56:38 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:39 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.info" returned: 0 in 0.301s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:39 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.info is being set with open permissions: ugo+rw Nov 01 08:56:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:39 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.info Nov 01 08:56:39 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:39 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.info" returned: 0 in 0.309s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-96c62916-db0b-4179-9418-b315cdbc9e1f tempest-VolumesSnapshotTestJSON-1001531051 None] Create snapshot completed successfully Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (61f268bf-bc56-4b72-a3e8-5910147876c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90422372-39c1-4047-8d21-a501238ee4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90422372-39c1-4047-8d21-a501238ee4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1209632997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2700a7-66b2-40f2-bad0-076d7a1f06ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:56:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fec7bec4-461a-410b-b340-70893b0bb256,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:56:41Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e346e4dd-293d-4dec-9ea8-4e4e59d6e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e346e4dd-293d-4dec-9ea8-4e4e59d6e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f96ccd0-883d-432f-9b48-2bc2c9b7dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f96ccd0-883d-432f-9b48-2bc2c9b7dbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d2700a7-66b2-40f2-bad0-076d7a1f06ec', 'volume_name': 'volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec', 'volume_size': 2, 'snapshot_id': 'fec7bec4-461a-410b-b340-70893b0bb256'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b82bf4-3e19-4453-a4d5-ae92e039749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b82bf4-3e19-4453-a4d5-ae92e039749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532b062a-18c1-4b0c-b125-a51874d0074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:41 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Volume 8d2700a7-66b2-40f2-bad0-076d7a1f06ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec', 'volume_size': 2, 'snapshot_id': 'fec7bec4-461a-410b-b340-70893b0bb256'} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-fec7bec4-461a-410b-b340-70893b0bb256-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-fec7bec4-461a-410b-b340-70893b0bb256-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Creating volume 8d2700a7-66b2-40f2-bad0-076d7a1f06ec from snapshot fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] snapshot: fec7bec4-461a-410b-b340-70893b0bb256, volume: 8d2700a7-66b2-40f2-bad0-076d7a1f06ec, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5af954-fba4-41f4-9fb6-0f096ba1dd95]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:41 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 Nov 01 08:56:41 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:42 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256" returned: 0 in 0.514s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b17871-f114-4415-a2e0-86d3b838a553]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:42 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 Nov 01 08:56:42 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:42 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" returned: 0 in 0.692s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 08:56:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:42 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec Nov 01 08:56:42 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:51 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=33,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:56:51 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=43,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:56:53 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" returned: 0 in 10.623s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98, size 1024.00 MB, duration 10.62 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:56:53 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Converted 1024.00 MB image at 96.39 MB/s Nov 01 08:56:53 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec is being set with open permissions: ugo+rw Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:53 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec Nov 01 08:56:53 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:53 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" returned: 0 in 0.285s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" released by "_copy_volume_from_snapshot" :: held 12.253s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-fec7bec4-461a-410b-b340-70893b0bb256-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" released by "_create_volume_from_snapshot" :: held 12.370s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.413s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532b062a-18c1-4b0c-b125-a51874d0074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec', 'volume_size': 2, 'snapshot_id': 'fec7bec4-461a-410b-b340-70893b0bb256'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ad6d30-3cfa-46d2-b37d-6e67437a2647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:56:53 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Volume volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec (8d2700a7-66b2-40f2-bad0-076d7a1f06ec): created successfully Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ad6d30-3cfa-46d2-b37d-6e67437a2647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:56:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (61f268bf-bc56-4b72-a3e8-5910147876c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:56:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b2460877-021a-48d1-ade5-7981a64fb2e8 tempest-VolumesSnapshotTestJSON-1001531051 None] Created volume successfully. Nov 01 08:56:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-5108b07a-dc37-48cf-8970-1102887f4306 req-77dade0d-67d3-4299-a888-9ab90dcd1538 tempest-ServerActionsTestOtherA-250974556 None] Terminate volume connection completed successfully. Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-5108b07a-dc37-48cf-8970-1102887f4306 req-77dade0d-67d3-4299-a888-9ab90dcd1538 tempest-ServerActionsTestOtherA-250974556 None] Deleting attachment 134612d0-2895-4861-9611-ce465a4e558d. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-8d2700a7-66b2-40f2-bad0-076d7a1f06ec-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-8d2700a7-66b2-40f2-bad0-076d7a1f06ec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e459036-bbab-4a42-bd03-29813f7a6ba5]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "cinder-049e88ab-c867-48b4-adb9-57fb4d76429b-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-049e88ab-c867-48b4-adb9-57fb4d76429b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:55 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec Nov 01 08:56:55 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "cinder-quobyte-049e88ab-c867-48b4-adb9-57fb4d76429b" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-quobyte-049e88ab-c867-48b4-adb9-57fb4d76429b" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[67511031-ff0a-4c31-b29f-23bfa795c316]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:55 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b Nov 01 08:56:55 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:55 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" returned: 0 in 0.608s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:55 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec Nov 01 08:56:55 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:56 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b" returned: 0 in 0.609s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:56 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b Nov 01 08:56:56 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:56 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" returned: 0 in 0.489s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-8d2700a7-66b2-40f2-bad0-076d7a1f06ec" released by "delete_volume" :: held 1.165s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['a76446df-0372-48cd-83d6-58ae6f7f0db6', 'f15499a9-9ce9-478f-b139-ccf100fd541b', 'c3da7e5c-9b17-4847-9c60-bf41dac52511', '0b07c85f-74e0-41c3-ac9d-997594a7bc60'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "cinder-6bd847a7-8cd1-46d2-a3e0-20c269d0e241-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-6bd847a7-8cd1-46d2-a3e0-20c269d0e241-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:56 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-049e88ab-c867-48b4-adb9-57fb4d76429b" returned: 0 in 0.736s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:56 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "cinder-quobyte-6bd847a7-8cd1-46d2-a3e0-20c269d0e241" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:56 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-quobyte-049e88ab-c867-48b4-adb9-57fb4d76429b" released by "delete_volume" :: held 1.436s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-quobyte-6bd847a7-8cd1-46d2-a3e0-20c269d0e241" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[37769791-c06f-4f1d-b2e3-06546c5365f6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:56 devstack cinder-volume[86770]: DEBUG cinder.quota [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Created reservations ['55bd3bf6-105e-4c79-aadd-623e1e2c9522', '6c2fb507-2bfb-4ec5-923a-3dfe1082dcc2', 'fd905332-90c8-48a2-a591-89f5f95d5c4b', 'c420373e-5851-4951-b04c-e000357021d6'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:56:57 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 Nov 01 08:56:57 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:57 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:56:57 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:57 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.526s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:56:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Deleted volume successfully. Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e148a9d9-edd3-4e37-b287-7850f3fb1d20 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-8d2700a7-66b2-40f2-bad0-076d7a1f06ec-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:57 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241" returned: 0 in 0.551s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:57 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241 Nov 01 08:56:57 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:57 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.459s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.manager [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-fec7bec4-461a-410b-b340-70893b0bb256-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Deleted volume successfully. Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-5108b07a-dc37-48cf-8970-1102887f4306 req-b04d8dd9-1825-4307-8a4e-5aea84cadbe3 tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-049e88ab-c867-48b4-adb9-57fb4d76429b-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-fec7bec4-461a-410b-b340-70893b0bb256-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-fec7bec4-461a-410b-b340-70893b0bb256" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-fec7bec4-461a-410b-b340-70893b0bb256" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Deleting offline snapshot fec7bec4-461a-410b-b340-70893b0bb256 of volume 4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] snapshot_file for this snap is: volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[648592db-9d18-40c7-8280-013b72eb98a2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:57 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 Nov 01 08:56:57 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:58 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6bd847a7-8cd1-46d2-a3e0-20c269d0e241" returned: 0 in 0.574s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-quobyte-6bd847a7-8cd1-46d2-a3e0-20c269d0e241" released by "delete_volume" :: held 1.260s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Created reservations ['9ec1d5db-c86b-4de5-a465-2d3fc5825202', '58c8a3e8-cb85-48a9-b157-7f69f3bc15a0', 'b95b279f-5f00-43ae-acee-e26b6f2cba54', '50cc00ea-90c6-4a19-b23b-939e5e3862da'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:58 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:56:58 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:58 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256" returned: 0 in 0.662s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84c4392-b8b2-4dcb-93c1-93330460212a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:58 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 Nov 01 08:56:58 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:58 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.364s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:56:58 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Deleted volume successfully. Nov 01 08:56:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2b946ec9-02a7-4d61-af09-1f8f722ad0fd tempest-ServerActionsTestOtherA-250974556 None] Lock "cinder-6bd847a7-8cd1-46d2-a3e0-20c269d0e241-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:56:59 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" returned: 0 in 0.680s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:59 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 Nov 01 08:56:59 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:56:59 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Nov 01 08:56:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256" returned: 0 in 0.697s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:56:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:56:59 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256 Nov 01 08:56:59 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:00 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98.fec7bec4-461a-410b-b340-70893b0bb256" returned: 0 in 0.303s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-fec7bec4-461a-410b-b340-70893b0bb256" released by "_delete_snapshot" :: held 2.530s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" released by "delete_snapshot" :: held 2.566s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:00 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['b5e1cc1b-e5b3-470a-9bc8-ee72d6cdc04f', 'f8a96f88-e4ec-4d51-938d-0255de421f08', 'ae657af0-9b41-4e20-b980-7aa6b3557c86', '8da5cf37-2ae5-40f1-9c69-cbe51b3ce054'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Delete snapshot completed successfully. Nov 01 08:57:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-87a6e7aa-d631-4b9c-b6da-6b04318ddd92 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-fec7bec4-461a-410b-b340-70893b0bb256-delete_snapshot" released by "delete_snapshot" :: held 2.747s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-4cf31ed5-8180-47f6-9a1e-b67f46fcac98-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-4cf31ed5-8180-47f6-9a1e-b67f46fcac98-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[34df71e8-d1bf-41d2-8b66-301865bebf81]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:01 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 Nov 01 08:57:01 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:01 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" returned: 0 in 0.538s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:01 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98 Nov 01 08:57:01 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:02 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" returned: 0 in 0.348s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-4cf31ed5-8180-47f6-9a1e-b67f46fcac98" released by "delete_volume" :: held 1.039s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['0c14c90f-94b1-4da9-83e7-a29f9aebfe27', 'f73609bd-63bb-42ec-ab1c-b9b0a4f26cd9', 'b6e242b6-847d-4b31-a0cd-d4394f0c6acf', '5636a70f-2b0b-49d3-9e5e-62fe8a4371b8'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:02 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:57:02 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:02 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.343s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:57:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Deleted volume successfully. Nov 01 08:57:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d5f923b2-f33c-44f6-8037-0fd270791c48 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-4cf31ed5-8180-47f6-9a1e-b67f46fcac98-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (de2ccc8d-d911-4ecf-bf70-bf335dceaee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5624f6b6-2c7e-4039-9d0c-0985653034fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5624f6b6-2c7e-4039-9d0c-0985653034fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1907074684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f562dd68-e4f8-46a7-9aba-83b48184adec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:04Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb81896d-f5fc-4036-8c85-a1419dea6cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb81896d-f5fc-4036-8c85-a1419dea6cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790d798b-0578-4a58-ac64-a332e4fec1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790d798b-0578-4a58-ac64-a332e4fec1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f562dd68-e4f8-46a7-9aba-83b48184adec', 'volume_name': 'volume-f562dd68-e4f8-46a7-9aba-83b48184adec', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede56051-f7fb-4645-9b5b-8ac51b21a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede56051-f7fb-4645-9b5b-8ac51b21a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dcb1a6-260f-4d36-8e89-89dbd5ae6bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:04 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Volume f562dd68-e4f8-46a7-9aba-83b48184adec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f562dd68-e4f8-46a7-9aba-83b48184adec', 'volume_size': 1} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1907074684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f562dd68-e4f8-46a7-9aba-83b48184adec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:04Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Creating volume f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:57:04 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:57:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:04 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec 1073741824 Nov 01 08:57:04 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Acquiring lock "cinder-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "cinder-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Acquiring lock "cinder-quobyte-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "cinder-quobyte-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:05 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec 1073741824" returned: 0 in 0.663s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41eb812-ef2f-49a3-85d6-61f68b30b376]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:05 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec Nov 01 08:57:05 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:05 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a Nov 01 08:57:05 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:05 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec" returned: 0 in 0.306s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dcb1a6-260f-4d36-8e89-89dbd5ae6bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f562dd68-e4f8-46a7-9aba-83b48184adec', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b177040-6274-4ca1-8324-21fd0c0e9549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Volume volume-f562dd68-e4f8-46a7-9aba-83b48184adec (f562dd68-e4f8-46a7-9aba-83b48184adec): created successfully Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b177040-6274-4ca1-8324-21fd0c0e9549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (de2ccc8d-d911-4ecf-bf70-bf335dceaee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2feef866-43ff-456f-95a0-f56376b2c2ee tempest-VolumesSnapshotTestJSON-1001531051 None] Created volume successfully. Nov 01 08:57:05 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a" returned: 0 in 0.501s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:05 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a Nov 01 08:57:05 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:05 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a" returned: 0 in 0.296s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "cinder-quobyte-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a" released by "delete_volume" :: held 0.864s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Created reservations ['56932e9e-2fc4-4be5-8868-4f15acbca417', '5ef19d0a-4c1c-4502-951b-5d79e1e78c9e', 'e3a1c876-31ce-41c6-9ec0-a7183c3a2c7e', '3035a06b-bfdc-4c4b-9436-28f857fcc34a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:06 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:57:06 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:06 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.414s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:57:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Deleted volume successfully. Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a3207b57-0689-47f6-837f-858d58388753 tempest-AttachVolumeShelveTestJSON-1670389575 None] Lock "cinder-e1d4cf19-d6ba-4e8f-9c0d-aa20c1f85d8a-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Creating offline snapshot 5874d3bb-467a-4861-904b-73c0bf0d88e1 of volume f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dcbfdc-c376-40e3-9701-469184c40726]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:07 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec Nov 01 08:57:07 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:07 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec" returned: 0 in 0.442s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:07 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 1G Nov 01 08:57:07 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:07 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 1G" returned: 0 in 0.570s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f562dd68-e4f8-46a7-9aba-83b48184adec -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:07 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f562dd68-e4f8-46a7-9aba-83b48184adec -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 Nov 01 08:57:07 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:08 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f562dd68-e4f8-46a7-9aba-83b48184adec -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1" returned: 0 in 0.312s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:08 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 is being set with open permissions: ugo+rw Nov 01 08:57:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:08 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 Nov 01 08:57:08 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:08 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1" returned: 0 in 0.284s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:08 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.info Nov 01 08:57:08 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:08 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.info" returned: 0 in 0.270s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:08 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.info is being set with open permissions: ugo+rw Nov 01 08:57:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:08 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.info Nov 01 08:57:08 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:09 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.info" returned: 0 in 0.321s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9833432c-50af-44fa-b7f7-ab36923543bf tempest-VolumesSnapshotTestJSON-1001531051 None] Create snapshot completed successfully Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (f73fe66f-dc48-42f4-acff-05e83e719708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29587890-96be-4722-acc1-a8a038a19329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29587890-96be-4722-acc1-a8a038a19329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-877311507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483d4117-9c62-4177-80cc-117f0c7057d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015329f49d8f4294bb6be7a00ea61a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5874d3bb-467a-4861-904b-73c0bf0d88e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:11Z,use_quota=True,user_id='5245ccf9d4c34a05890ee2ba35aa6cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3044f1f-80d3-4d3e-a434-97e272a3a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3044f1f-80d3-4d3e-a434-97e272a3a942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55dd5f6-f69a-4b18-9433-09d907e4aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55dd5f6-f69a-4b18-9433-09d907e4aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '483d4117-9c62-4177-80cc-117f0c7057d7', 'volume_name': 'volume-483d4117-9c62-4177-80cc-117f0c7057d7', 'volume_size': 1, 'snapshot_id': '5874d3bb-467a-4861-904b-73c0bf0d88e1'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212c0139-a7c9-45cd-9fd2-f23cc5291b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212c0139-a7c9-45cd-9fd2-f23cc5291b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c12a477-77da-4110-af5b-cba801c9da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:10 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Volume 483d4117-9c62-4177-80cc-117f0c7057d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-483d4117-9c62-4177-80cc-117f0c7057d7', 'volume_size': 1, 'snapshot_id': '5874d3bb-467a-4861-904b-73c0bf0d88e1'} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-5874d3bb-467a-4861-904b-73c0bf0d88e1-483d4117-9c62-4177-80cc-117f0c7057d7" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-5874d3bb-467a-4861-904b-73c0bf0d88e1-483d4117-9c62-4177-80cc-117f0c7057d7" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Creating volume 483d4117-9c62-4177-80cc-117f0c7057d7 from snapshot 5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-483d4117-9c62-4177-80cc-117f0c7057d7" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-483d4117-9c62-4177-80cc-117f0c7057d7" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] snapshot: 5874d3bb-467a-4861-904b-73c0bf0d88e1, volume: 483d4117-9c62-4177-80cc-117f0c7057d7, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3522bb-036c-4d5b-8cdf-24e466b89365]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:11 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 Nov 01 08:57:11 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:11 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1" returned: 0 in 0.661s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f562dd68-e4f8-46a7-9aba-83b48184adec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5af5c5-b238-42d0-8613-7bd5923eb1a4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:11 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec Nov 01 08:57:11 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:12 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec" returned: 0 in 0.622s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 08:57:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 08:57:12 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 08:57:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:12 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 Nov 01 08:57:12 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:20 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=56,cinder:INSERT=14,cinder:DELETE=7,cinder:SELECT=38 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:57:20 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=43,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:57:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:57:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:21 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:57:21 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:22 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 1.077s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:22 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:57:22 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:57:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:57:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Flow 'volume_create_manager' (ccc49848-d6d0-4ea6-b2ad-58913e947662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429dab7b-278f-4520-a755-188088cc0740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429dab7b-278f-4520-a755-188088cc0740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1577249070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ed8fed-42c8-4aa3-acd5-740c10502610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7157924d3437425798d2777b19ced9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:24Z,use_quota=True,user_id='ae89ea8e676f424db5e2aef936256f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a91782a-8c94-4eb5-94b7-a3eeb5a26f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a91782a-8c94-4eb5-94b7-a3eeb5a26f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec38c1a7-6acc-4438-8173-82031e2773b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec38c1a7-6acc-4438-8173-82031e2773b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ed8fed-42c8-4aa3-acd5-740c10502610', 'volume_name': 'volume-65ed8fed-42c8-4aa3-acd5-740c10502610', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ed49c5-e86f-4350-8a6c-5289ad0fde0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ed49c5-e86f-4350-8a6c-5289ad0fde0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08ebe94-e348-48bd-9be3-1cdf43db9861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:23 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Volume 65ed8fed-42c8-4aa3-acd5-740c10502610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ed8fed-42c8-4aa3-acd5-740c10502610', 'volume_size': 1} Nov 01 08:57:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7" returned: 0 in 11.856s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec, size 1024.00 MB, duration 11.86 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:57:24 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Converted 1024.00 MB image at 86.36 MB/s Nov 01 08:57:24 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 is being set with open permissions: ugo+rw Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:24 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 Nov 01 08:57:24 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:24 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7" returned: 0 in 0.411s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-483d4117-9c62-4177-80cc-117f0c7057d7" released by "_copy_volume_from_snapshot" :: held 13.695s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-5874d3bb-467a-4861-904b-73c0bf0d88e1-483d4117-9c62-4177-80cc-117f0c7057d7" released by "_create_volume_from_snapshot" :: held 13.795s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.819s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.666s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1577249070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ed8fed-42c8-4aa3-acd5-740c10502610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7157924d3437425798d2777b19ced9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:24Z,use_quota=True,user_id='ae89ea8e676f424db5e2aef936256f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Creating volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:57:24 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:24 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 1073741824 Nov 01 08:57:24 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c12a477-77da-4110-af5b-cba801c9da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483d4117-9c62-4177-80cc-117f0c7057d7', 'volume_size': 1, 'snapshot_id': '5874d3bb-467a-4861-904b-73c0bf0d88e1'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fd26d3-3ef0-4033-8254-aa821801d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Volume volume-483d4117-9c62-4177-80cc-117f0c7057d7 (483d4117-9c62-4177-80cc-117f0c7057d7): created successfully Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fd26d3-3ef0-4033-8254-aa821801d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Flow 'volume_create_manager' (f73fe66f-dc48-42f4-acff-05e83e719708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-76c0a79a-fb9b-4879-ac24-8ba3f51deb8d tempest-VolumesSnapshotTestJSON-1001531051 None] Created volume successfully. Nov 01 08:57:25 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 1073741824" returned: 0 in 0.569s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:25 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 Nov 01 08:57:25 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:25 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610" returned: 0 in 0.370s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08ebe94-e348-48bd-9be3-1cdf43db9861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ed8fed-42c8-4aa3-acd5-740c10502610', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27842ebd-cb18-474b-bcf6-e5766f6ded8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Volume volume-65ed8fed-42c8-4aa3-acd5-740c10502610 (65ed8fed-42c8-4aa3-acd5-740c10502610): created successfully Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27842ebd-cb18-474b-bcf6-e5766f6ded8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Flow 'volume_create_manager' (ccc49848-d6d0-4ea6-b2ad-58913e947662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ae1c42ed-8905-4404-8495-f888967c4649 tempest-SnapshotsActionsTest-687616208 None] Created volume successfully. Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-483d4117-9c62-4177-80cc-117f0c7057d7-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-483d4117-9c62-4177-80cc-117f0c7057d7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-483d4117-9c62-4177-80cc-117f0c7057d7" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-483d4117-9c62-4177-80cc-117f0c7057d7" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:26 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc7507c-5f07-4486-9c20-72564a82fcc0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:26 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 Nov 01 08:57:26 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:26 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7" returned: 0 in 0.497s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:26 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7 Nov 01 08:57:26 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Creating offline snapshot f3347e18-1c0d-4c77-a651-4eb845f96e6a of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b9b58c-d61b-40d5-bdc5-ac321641cd4b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:27 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-483d4117-9c62-4177-80cc-117f0c7057d7" returned: 0 in 0.655s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:27 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 Nov 01 08:57:27 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-483d4117-9c62-4177-80cc-117f0c7057d7" released by "delete_volume" :: held 1.258s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Flow 'volume_create_manager' (1c074da0-1dbb-4347-8b5a-639b475cf5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543106ae-7fd8-4e81-bcef-10c07b25bf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543106ae-7fd8-4e81-bcef-10c07b25bf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1710210078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a85af5d-eaeb-41d6-91eb-2e3288116e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392da85b95ea4ea68021d5c3b3807ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:27Z,use_quota=True,user_id='46787df1c84c43498280432b51cc3ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85761f7-739c-45e7-bdf3-4caaed3019dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85761f7-739c-45e7-bdf3-4caaed3019dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f564b0f-67fe-4477-b1fe-876ecb41882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f564b0f-67fe-4477-b1fe-876ecb41882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a85af5d-eaeb-41d6-91eb-2e3288116e1f', 'volume_name': 'volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3ea00d-c05c-4c6c-8e18-3209f593e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3ea00d-c05c-4c6c-8e18-3209f593e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda05abb-fe73-49cc-9557-5a9aa48c8dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Volume 6a85af5d-eaeb-41d6-91eb-2e3288116e1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f', 'volume_size': 1} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['09092dca-a88c-4d8c-8f2a-13a8015ff029', '77623b7f-94cb-4c52-8dab-8f9f2f2b9854', '69e712c0-b23c-4a77-88d0-55ab8b9b0db3', 'fcb9120d-d7a7-48a7-8560-42d41983b6f1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:27 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:57:27 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:27 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610" returned: 0 in 0.633s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:27 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a 1G Nov 01 08:57:27 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:27 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.293s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:57:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Deleted volume successfully. Nov 01 08:57:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7e84e52-6caa-41ac-9916-d07738f212b1 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-483d4117-9c62-4177-80cc-117f0c7057d7-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:28 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a 1G" returned: 0 in 0.599s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-5874d3bb-467a-4861-904b-73c0bf0d88e1-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:28 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:28 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-5874d3bb-467a-4861-904b-73c0bf0d88e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-f562dd68-e4f8-46a7-9aba-83b48184adec" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-f562dd68-e4f8-46a7-9aba-83b48184adec" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-5874d3bb-467a-4861-904b-73c0bf0d88e1" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-5874d3bb-467a-4861-904b-73c0bf0d88e1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Deleting offline snapshot 5874d3bb-467a-4861-904b-73c0bf0d88e1 of volume f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] snapshot_file for this snap is: volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc42996-5c87-4c2c-a67a-088c5c855bc0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:28 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 Nov 01 08:57:28 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:28 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.620s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:28 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a is being set with open permissions: ugo+rw Nov 01 08:57:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:29 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:29 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:29 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1" returned: 0 in 0.652s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f562dd68-e4f8-46a7-9aba-83b48184adec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa308a-76a0-407e-bd61-ddb74828fe3a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:29 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.326s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:29 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.info Nov 01 08:57:29 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:29 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec Nov 01 08:57:29 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:29 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.info" returned: 0 in 0.577s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:29 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.info is being set with open permissions: ugo+rw Nov 01 08:57:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:29 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.info Nov 01 08:57:29 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:30 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec" returned: 0 in 1.096s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:30 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.info" returned: 0 in 0.465s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:30 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 Nov 01 08:57:30 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.433s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1710210078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a85af5d-eaeb-41d6-91eb-2e3288116e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392da85b95ea4ea68021d5c3b3807ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:27Z,use_quota=True,user_id='46787df1c84c43498280432b51cc3ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Creating volume 6a85af5d-eaeb-41d6-91eb-2e3288116e1f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:57:30 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:30 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f 1073741824 Nov 01 08:57:30 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-648a7e34-a3a2-41b7-b792-7dcf114cba27 tempest-SnapshotsActionsTest-687616208 None] Create snapshot completed successfully Nov 01 08:57:30 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1" returned: 0 in 0.590s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:31 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1 Nov 01 08:57:31 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:31 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec.5874d3bb-467a-4861-904b-73c0bf0d88e1" returned: 0 in 0.450s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:31 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f 1073741824" returned: 0 in 1.032s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-5874d3bb-467a-4861-904b-73c0bf0d88e1" released by "_delete_snapshot" :: held 3.050s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-f562dd68-e4f8-46a7-9aba-83b48184adec" released by "delete_snapshot" :: held 3.124s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:31 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f Nov 01 08:57:31 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:31 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['5889e225-c25e-4887-b9a0-6f8fda3069bb', 'a55cf642-4c67-4533-8156-87cb8cf76549', 'd48bd179-a6fe-4b43-b729-5720c01c1a4a', '1bc084e7-377f-4792-8826-dbd83559e59d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Delete snapshot completed successfully. Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4a6ab56b-f6d9-4cce-9abb-3c1aa5c17bd2 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-5874d3bb-467a-4861-904b-73c0bf0d88e1-delete_snapshot" released by "delete_snapshot" :: held 3.563s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:32 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f" returned: 0 in 0.538s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda05abb-fe73-49cc-9557-5a9aa48c8dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8373a2-f50e-40e4-aeec-eae707954146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:32 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Volume volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f (6a85af5d-eaeb-41d6-91eb-2e3288116e1f): created successfully Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8373a2-f50e-40e4-aeec-eae707954146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Flow 'volume_create_manager' (1c074da0-1dbb-4347-8b5a-639b475cf5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-22936531-3a28-4235-ad6d-e350bd3617a1 tempest-TestMinimumBasicScenario-709585286 None] Created volume successfully. Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Creating offline snapshot ca950c18-6a9b-4290-a2e5-bcaf90a7a32d of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3077e-341e-4453-926b-8136fe1d2568]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:33 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:33 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-f562dd68-e4f8-46a7-9aba-83b48184adec-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-f562dd68-e4f8-46a7-9aba-83b48184adec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-f562dd68-e4f8-46a7-9aba-83b48184adec" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-f562dd68-e4f8-46a7-9aba-83b48184adec" acquired by "delete_volume" :: waited 0.046s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b2ec0-7ad2-430b-82ea-5aa80df8f6b6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:33 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.804s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:33 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec Nov 01 08:57:33 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:33 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d 1G Nov 01 08:57:33 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:34 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec" returned: 0 in 0.663s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:34 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec Nov 01 08:57:34 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:34 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d 1G" returned: 0 in 0.966s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:34 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-68eae287-c334-4647-a15d-073a1da779e3 req-578501fa-7aab-4e56-aa97-9f4fae77dc83 tempest-TestMinimumBasicScenario-709585286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:34 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:34 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f562dd68-e4f8-46a7-9aba-83b48184adec" returned: 0 in 0.554s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-f562dd68-e4f8-46a7-9aba-83b48184adec" released by "delete_volume" :: held 1.359s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['427ed5e3-46bc-4682-984f-739b1a974413', 'd5f87b2f-8cf3-434f-9efe-905d479b0edc', '3fff2029-cb6f-4a78-b6a9-2a56c04f35be', 'b764e962-4694-4b27-9a8b-d707e3486e0e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:35 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:57:35 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:35 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" returned: 0 in 0.539s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:35 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d is being set with open permissions: ugo+rw Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:35 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d Nov 01 08:57:35 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:35 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.442s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:57:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Deleted volume successfully. Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ded2297a-680e-4523-8780-9855a9c57276 tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-f562dd68-e4f8-46a7-9aba-83b48184adec-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:35 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" returned: 0 in 0.603s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.094s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-68eae287-c334-4647-a15d-073a1da779e3 req-578501fa-7aab-4e56-aa97-9f4fae77dc83 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.179s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-a188605d-14bd-4a68-a399-d7dd7473bdba-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-68eae287-c334-4647-a15d-073a1da779e3 req-578501fa-7aab-4e56-aa97-9f4fae77dc83 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.072s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-a188605d-14bd-4a68-a399-d7dd7473bdba-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-bd9f1278-878d-4775-9cbd-205f89ae8164 tempest-SnapshotsActionsTest-687616208 None] Create snapshot completed successfully Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "cinder-quobyte-a188605d-14bd-4a68-a399-d7dd7473bdba" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-68eae287-c334-4647-a15d-073a1da779e3 req-578501fa-7aab-4e56-aa97-9f4fae77dc83 tempest-TestMinimumBasicScenario-709585286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '643c25d9-84fa-4c14-b877-122c4565dd09', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:57:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-a188605d-14bd-4a68-a399-d7dd7473bdba" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec5b1a-1154-4676-94c2-cdd2c8974a7e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-68eae287-c334-4647-a15d-073a1da779e3 req-578501fa-7aab-4e56-aa97-9f4fae77dc83 tempest-TestMinimumBasicScenario-709585286 None] attachment_update completed successfully. Nov 01 08:57:36 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba Nov 01 08:57:36 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:36 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba" returned: 0 in 0.539s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:36 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba Nov 01 08:57:36 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:36 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a188605d-14bd-4a68-a399-d7dd7473bdba" returned: 0 in 0.325s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-quobyte-a188605d-14bd-4a68-a399-d7dd7473bdba" released by "delete_volume" :: held 0.967s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Created reservations ['f32b0c96-ca7a-47ec-83b3-3ea81029eb91', 'c7d07fbe-e044-47d0-b600-e285dcaf4e29', 'c38f9cb3-d5d2-4a4a-be47-1547e32e98bf', 'bb06db99-c030-4ef3-ab8b-bfa68e9f2e15'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-ca950c18-6a9b-4290-a2e5-bcaf90a7a32d-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-ca950c18-6a9b-4290-a2e5-bcaf90a7a32d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:37 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:57:37 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Deleting offline snapshot ca950c18-6a9b-4290-a2e5-bcaf90a7a32d of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] snapshot_file for this snap is: volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dedb521-1138-4c6f-9c34-9065278308c9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:37 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d Nov 01 08:57:37 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:37 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.333s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:57:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Deleted volume successfully. Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2a42860-fd28-455a-a55f-86dc0ab51bbb tempest-VolumesSnapshotTestJSON-1001531051 None] Lock "cinder-a188605d-14bd-4a68-a399-d7dd7473bdba-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:37 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" returned: 0 in 0.441s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6980e-e22c-41d8-b4c8-1dd83a123411]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:37 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:37 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:38 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.459s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:38 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d Nov 01 08:57:38 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:38 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" returned: 0 in 0.480s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:38 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d Nov 01 08:57:38 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:38 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-ca950c18-6a9b-4290-a2e5-bcaf90a7a32d" released by "_delete_snapshot" :: held 1.799s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" released by "delete_snapshot" :: held 1.826s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Created reservations ['dabc55c3-080a-4d07-865d-586976b22fc7', 'c8d71ba2-8686-4cae-8c65-cc1978dc116f', 'c785ee10-3a5f-4ed2-8c20-34e815299720', '25dd4a7c-cafa-4097-ab46-aec9212f0df1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Delete snapshot completed successfully. Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-03312803-b871-4e26-9d78-9738a3cf3b88 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-ca950c18-6a9b-4290-a2e5-bcaf90a7a32d-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Creating offline snapshot 3c95cb95-fd6f-4d65-babb-2faf2ca955b1 of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86b76f5-5f9b-4f7f-8538-bf5e5e2122b7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:39 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:39 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:40 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.461s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:40 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 1G Nov 01 08:57:40 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:40 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 1G" returned: 0 in 0.523s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:40 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 Nov 01 08:57:40 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:41 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1" returned: 0 in 0.316s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:41 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 is being set with open permissions: ugo+rw Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:41 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 Nov 01 08:57:41 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:41 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1" returned: 0 in 0.268s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.713s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-21bf2057-4cc5-4771-b27f-ac95af51e96c tempest-SnapshotsActionsTest-687616208 None] Create snapshot completed successfully Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-3c95cb95-fd6f-4d65-babb-2faf2ca955b1-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-3c95cb95-fd6f-4d65-babb-2faf2ca955b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-3c95cb95-fd6f-4d65-babb-2faf2ca955b1" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-3c95cb95-fd6f-4d65-babb-2faf2ca955b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Deleting offline snapshot 3c95cb95-fd6f-4d65-babb-2faf2ca955b1 of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:57:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] snapshot_file for this snap is: volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce2b778-0891-4214-a8b2-360615c150e7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:42 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 Nov 01 08:57:42 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:42 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1" returned: 0 in 0.410s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[831b2c07-3f47-45e7-a1c7-ce27b696ed32]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:42 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:42 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:42 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.533s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:43 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 Nov 01 08:57:43 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:43 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1" returned: 0 in 0.507s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:43 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1 Nov 01 08:57:43 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:43 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.3c95cb95-fd6f-4d65-babb-2faf2ca955b1" returned: 0 in 0.324s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-3c95cb95-fd6f-4d65-babb-2faf2ca955b1" released by "_delete_snapshot" :: held 1.913s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" released by "delete_snapshot" :: held 1.944s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:43 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Created reservations ['23601f85-379f-43b3-99ec-ae5c53a9e70b', 'ca6829ca-c699-43ef-84b7-5909159275d0', 'e2439011-e9ea-4f0f-85fb-7cf9154a7b56', 'e4673899-adf4-44de-9875-1a6a3babc5e6'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Delete snapshot completed successfully. Nov 01 08:57:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c3c667f0-431d-43bf-975f-72788b216b22 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-3c95cb95-fd6f-4d65-babb-2faf2ca955b1-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Creating offline snapshot c054aa09-2e26-4443-a12d-61634333eceb of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c85a322-e034-4b03-b128-70ce931d39d0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:45 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:45 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:45 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.574s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:45 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb 1G Nov 01 08:57:45 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:46 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb 1G" returned: 0 in 0.931s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:46 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb Nov 01 08:57:46 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:46 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:46 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb is being set with open permissions: ugo+rw Nov 01 08:57:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:47 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb Nov 01 08:57:47 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:47 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb" returned: 0 in 0.397s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a1da89b0-59ff-4244-aa8d-21b563e559d6 tempest-SnapshotsActionsTest-687616208 None] Create snapshot completed successfully Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-c054aa09-2e26-4443-a12d-61634333eceb-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-c054aa09-2e26-4443-a12d-61634333eceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-c054aa09-2e26-4443-a12d-61634333eceb" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-c054aa09-2e26-4443-a12d-61634333eceb" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Deleting offline snapshot c054aa09-2e26-4443-a12d-61634333eceb of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] snapshot_file for this snap is: volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20f1160-ca98-4d12-b86d-d8c8d2cbff64]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:48 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb Nov 01 08:57:48 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:49 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb" returned: 0 in 0.556s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:49 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3827e9-c931-43e7-b2b9-7b6c72d223bb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:49 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:49 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:49 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.714s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:50 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb Nov 01 08:57:50 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Flow 'volume_create_manager' (70dcef49-22da-4406-9cc2-35693d0fa8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef813e-75f4-4c91-9a8f-958e1d6726c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef813e-75f4-4c91-9a8f-958e1d6726c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-359168932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef301d7-321f-47d8-ad6d-e23551a7f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4833728e14dc43bc9a54bafd44b5d3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:50Z,use_quota=True,user_id='52f1e50d638c415b8f065660b71ae9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1304a5-ac99-42a5-a6da-fecb9d5ef0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc1304a5-ac99-42a5-a6da-fecb9d5ef0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515553c5-25d3-4b7b-b4e8-0b166b2c4e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515553c5-25d3-4b7b-b4e8-0b166b2c4e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef301d7-321f-47d8-ad6d-e23551a7f88f', 'volume_name': 'volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4feb3b91-d222-4353-a6c0-22a80a053326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4feb3b91-d222-4353-a6c0-22a80a053326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05a1788-b1a3-46f0-8b04-35358a989e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f', 'volume_size': 1} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-359168932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef301d7-321f-47d8-ad6d-e23551a7f88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4833728e14dc43bc9a54bafd44b5d3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:57:50Z,use_quota=True,user_id='52f1e50d638c415b8f065660b71ae9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Creating volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:57:50 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:50 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f 1073741824 Nov 01 08:57:50 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:50 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb" returned: 0 in 0.717s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:50 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb Nov 01 08:57:50 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:50 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f 1073741824" returned: 0 in 0.617s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:51 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f Nov 01 08:57:51 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:51 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.c054aa09-2e26-4443-a12d-61634333eceb" returned: 0 in 0.357s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-c054aa09-2e26-4443-a12d-61634333eceb" released by "_delete_snapshot" :: held 2.566s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" released by "delete_snapshot" :: held 2.618s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Created reservations ['687fe3d8-eb4b-4788-993d-55c7cf18886d', '4325b891-c009-4326-8002-25ed03aeb32e', 'b8a9a18c-cff4-4ed2-8dc6-ab3de2e7d3d2', 'ae0b3f43-3f26-4e48-95e8-ad22aa10f29d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Delete snapshot completed successfully. Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8ff29dd1-215e-4716-800e-298b2a75f1a4 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-c054aa09-2e26-4443-a12d-61634333eceb-delete_snapshot" released by "delete_snapshot" :: held 2.899s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:51 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f" returned: 0 in 0.397s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05a1788-b1a3-46f0-8b04-35358a989e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48881367-f199-4059-a03b-6bd7eb9c368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:57:51 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Volume volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f (0ef301d7-321f-47d8-ad6d-e23551a7f88f): created successfully Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48881367-f199-4059-a03b-6bd7eb9c368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:57:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Flow 'volume_create_manager' (70dcef49-22da-4406-9cc2-35693d0fa8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:57:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ac48b24e-786c-4796-9585-1d5ca6a8c527 tempest-VolumesSnapshotListTestJSON-624627540 None] Created volume successfully. Nov 01 08:57:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Creating offline snapshot a65f2af4-958f-479f-8ebc-7c444495339b of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1df7ee-3696-4240-bfe4-60af9c2b12d8]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:53 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:53 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:53 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.530s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:53 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b 1G Nov 01 08:57:53 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:54 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b 1G" returned: 0 in 0.611s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:54 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b Nov 01 08:57:54 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:54 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b" returned: 0 in 0.305s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:54 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b is being set with open permissions: ugo+rw Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:54 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b Nov 01 08:57:54 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:54 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b" returned: 0 in 0.279s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.760s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Creating offline snapshot 882d58a0-1275-476f-80d5-3c76325f63fc of volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0f5ee264-8dc4-48ee-a607-76619e052356 tempest-SnapshotsActionsTest-687616208 None] Create snapshot completed successfully Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e77daa6-c7b1-4685-a36d-67ffbffdad14]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:54 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f Nov 01 08:57:54 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-a65f2af4-958f-479f-8ebc-7c444495339b-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-a65f2af4-958f-479f-8ebc-7c444495339b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Acquiring lock "cinder-quobyte-a65f2af4-958f-479f-8ebc-7c444495339b" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-a65f2af4-958f-479f-8ebc-7c444495339b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Deleting offline snapshot a65f2af4-958f-479f-8ebc-7c444495339b of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] snapshot_file for this snap is: volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c303a27-5681-4464-9d0e-4132edca9467]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:55 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f" returned: 0 in 0.614s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:55 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc 1G Nov 01 08:57:55 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:55 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b Nov 01 08:57:55 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:55 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b" returned: 0 in 0.435s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f2bf60-4d66-4846-af6d-5c98dd75d144]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:56 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:56 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:56 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc 1G" returned: 0 in 0.752s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:56 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc Nov 01 08:57:56 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:56 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.679s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:56 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b Nov 01 08:57:56 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:56 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc" returned: 0 in 0.571s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:56 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc is being set with open permissions: ugo+rw Nov 01 08:57:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:56 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc Nov 01 08:57:56 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:57 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b" returned: 0 in 0.549s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:57 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:57 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b Nov 01 08:57:57 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc" returned: 0 in 0.391s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:57 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.info Nov 01 08:57:57 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:57 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.a65f2af4-958f-479f-8ebc-7c444495339b" returned: 0 in 0.319s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-a65f2af4-958f-479f-8ebc-7c444495339b" released by "_delete_snapshot" :: held 2.145s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" released by "delete_snapshot" :: held 2.182s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:57 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.info" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:57 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.info is being set with open permissions: ugo+rw Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:57 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.info Nov 01 08:57:57 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Created reservations ['0d210b45-7145-40a8-94b2-72b131ca7bc8', '36d7d219-51c0-4180-9237-3916bec5172b', 'cf542774-9d9a-4792-8bc0-1b71eef264bc', 'e5b69634-6767-4802-beeb-fc4c80951a98'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:57:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Delete snapshot completed successfully. Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d223aca-efa0-44ed-ab57-fe306c452db0 tempest-SnapshotsActionsTest-2075305370 None] Lock "cinder-a65f2af4-958f-479f-8ebc-7c444495339b-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:57:57 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.info" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:57:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-16aea655-dbf1-45c7-b9ee-3d8972727796 tempest-VolumesSnapshotListTestJSON-624627540 None] Create snapshot completed successfully Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Creating offline snapshot 695e60fb-33d7-4f17-90c8-84e21b6d4225 of volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80ad61f-59b2-4b89-92fa-83f635ff0b43]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:58 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc Nov 01 08:57:58 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:58 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc" returned: 0 in 0.390s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:58 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 1G Nov 01 08:57:58 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:59 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 1G" returned: 0 in 0.523s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:59 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 Nov 01 08:57:59 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "cinder-f3347e18-1c0d-4c77-a651-4eb845f96e6a-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-f3347e18-1c0d-4c77-a651-4eb845f96e6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "cinder-quobyte-f3347e18-1c0d-4c77-a651-4eb845f96e6a" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-quobyte-f3347e18-1c0d-4c77-a651-4eb845f96e6a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Deleting offline snapshot f3347e18-1c0d-4c77-a651-4eb845f96e6a of volume 65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] snapshot_file for this snap is: volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489a259-309a-484a-a1e3-aa4bda2693f1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:59 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:57:59 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:59 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225" returned: 0 in 0.372s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:59 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 is being set with open permissions: ugo+rw Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:59 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 Nov 01 08:57:59 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:57:59 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65ed8fed-42c8-4aa3-acd5-740c10502610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48a409a-98a5-46ac-9e6a-4359d13fd432]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:57:59 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Nov 01 08:57:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225" returned: 0 in 0.276s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.684s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-352a603c-e965-4cb5-a413-554661ac5804 tempest-VolumesSnapshotListTestJSON-624627540 None] Create snapshot completed successfully Nov 01 08:58:00 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 Nov 01 08:58:00 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:00 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610" returned: 0 in 0.417s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:00 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:58:00 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Creating offline snapshot bec8310b-de5b-4c49-9697-6a72781546a4 of volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 08:58:00 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.567s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cf2162-60bf-4dc7-b367-e7efdc4544ac]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:00 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a Nov 01 08:58:00 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:01 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 Nov 01 08:58:01 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:01 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610.f3347e18-1c0d-4c77-a651-4eb845f96e6a" returned: 0 in 0.292s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-quobyte-f3347e18-1c0d-4c77-a651-4eb845f96e6a" released by "_delete_snapshot" :: held 1.790s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" released by "delete_snapshot" :: held 1.821s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:01 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Created reservations ['a73ca209-e9dd-4b56-8f8f-0b5fdeb2803a', 'c07841bc-3a45-4d68-b5ad-40ca340f8926', '1055c610-8416-48b1-a1bd-040a2aa545d4', '2d9c9ffc-603b-44ae-8477-5633b0d28e6c'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225" returned: 0 in 0.421s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:01 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 1G Nov 01 08:58:01 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:01 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Delete snapshot completed successfully. Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b4e5024-9121-4be5-8313-7b27654a540b tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-f3347e18-1c0d-4c77-a651-4eb845f96e6a-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "cinder-65ed8fed-42c8-4aa3-acd5-740c10502610-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-65ed8fed-42c8-4aa3-acd5-740c10502610-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e70b1a-70d3-4d53-94e7-c0f6bb8ea8f5]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:01 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 1G" returned: 0 in 0.601s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:02 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 Nov 01 08:58:02 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:02 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 Nov 01 08:58:02 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:02 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610" returned: 0 in 0.438s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:02 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4" returned: 0 in 0.364s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:02 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 is being set with open permissions: ugo+rw Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:02 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610 Nov 01 08:58:02 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:02 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 Nov 01 08:58:02 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:02 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-65ed8fed-42c8-4aa3-acd5-740c10502610" returned: 0 in 0.269s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-quobyte-65ed8fed-42c8-4aa3-acd5-740c10502610" released by "delete_volume" :: held 0.783s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:02 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4" returned: 0 in 0.300s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-39f9fca9-4155-47b2-8500-48e5654a9939 tempest-VolumesSnapshotListTestJSON-624627540 None] Create snapshot completed successfully Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Created reservations ['995232cf-db3a-4a33-95e6-f570f0627718', '31167f09-4842-4226-b90f-69c9ac44f472', 'd1e86d51-df3f-4d96-816a-f7a5d7026928', 'e3d45750-a58e-46c1-ae3b-f51d14791c37'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:02 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:58:02 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:03 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.337s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:03 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:58:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Deleted volume successfully. Nov 01 08:58:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d12134c-7ff4-434c-9adc-3cd93224da7f tempest-SnapshotsActionsTest-687616208 None] Lock "cinder-65ed8fed-42c8-4aa3-acd5-740c10502610-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-bec8310b-de5b-4c49-9697-6a72781546a4-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-bec8310b-de5b-4c49-9697-6a72781546a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-quobyte-bec8310b-de5b-4c49-9697-6a72781546a4" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-bec8310b-de5b-4c49-9697-6a72781546a4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Deleting offline snapshot bec8310b-de5b-4c49-9697-6a72781546a4 of volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] snapshot_file for this snap is: volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82e62a0-b6b6-4bff-ae29-96df73a61409]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:04 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 Nov 01 08:58:04 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:05 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4" returned: 0 in 0.561s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:58:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2fcdf-b61d-4e8c-a984-22ca0e2dc1d4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:05 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 Nov 01 08:58:05 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:05 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225" returned: 0 in 0.660s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:58:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:05 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 Nov 01 08:58:05 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:06 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4" returned: 0 in 0.725s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:06 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4 Nov 01 08:58:06 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:06 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.bec8310b-de5b-4c49-9697-6a72781546a4" returned: 0 in 0.422s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-bec8310b-de5b-4c49-9697-6a72781546a4" released by "_delete_snapshot" :: held 2.631s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" released by "delete_snapshot" :: held 2.675s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Created reservations ['0c779d6c-d149-4dd0-a298-9130acf6e9c9', '869a0db6-73e1-436d-ac84-5a5cc756d249', 'f9d87ac0-0145-4830-b4f2-78000590f6d4', '6e14650e-e152-41d7-a7a6-8a0a1ebe6eaf'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Delete snapshot completed successfully. Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-61ef06a1-b5b0-4231-8c0e-897f0481de50 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-bec8310b-de5b-4c49-9697-6a72781546a4-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-695e60fb-33d7-4f17-90c8-84e21b6d4225-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-695e60fb-33d7-4f17-90c8-84e21b6d4225-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-quobyte-695e60fb-33d7-4f17-90c8-84e21b6d4225" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-695e60fb-33d7-4f17-90c8-84e21b6d4225" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Deleting offline snapshot 695e60fb-33d7-4f17-90c8-84e21b6d4225 of volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] snapshot_file for this snap is: volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9407f2a-1984-4c2c-9412-3cf1c32a7c50]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:07 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 Nov 01 08:58:07 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:08 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225" returned: 0 in 0.428s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:58:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c05206-604c-4a57-9f69-cd133c689ec7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:08 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc Nov 01 08:58:08 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:08 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc" returned: 0 in 0.448s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:58:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:08 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 Nov 01 08:58:08 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:09 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225" returned: 0 in 0.440s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:09 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225 Nov 01 08:58:09 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:09 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.695e60fb-33d7-4f17-90c8-84e21b6d4225" returned: 0 in 0.287s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-695e60fb-33d7-4f17-90c8-84e21b6d4225" released by "_delete_snapshot" :: held 1.735s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" released by "delete_snapshot" :: held 1.773s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Created reservations ['74fcd48d-dd75-4933-ba3d-170747824ffc', 'bcea6d0f-2091-4baa-a9e8-cc16ea50f7d2', '7976a370-0172-4879-8e60-f2598a9e7cbc', '1cf72b81-96a6-458a-8077-c0044920b223'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Delete snapshot completed successfully. Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-35fd522a-7ae4-4290-91fc-b41d0ebe4ad0 tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-695e60fb-33d7-4f17-90c8-84e21b6d4225-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-882d58a0-1275-476f-80d5-3c76325f63fc-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-882d58a0-1275-476f-80d5-3c76325f63fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-quobyte-882d58a0-1275-476f-80d5-3c76325f63fc" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-882d58a0-1275-476f-80d5-3c76325f63fc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Deleting offline snapshot 882d58a0-1275-476f-80d5-3c76325f63fc of volume 0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] snapshot_file for this snap is: volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdd5d0a-c5fb-4370-b1fc-b0c584fc8df1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:09 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc Nov 01 08:58:09 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:10 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc" returned: 0 in 0.406s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 08:58:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6430f694-957a-4298-8e55-6f532f98d64b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:10 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f Nov 01 08:58:10 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:10 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f" returned: 0 in 0.425s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:10 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc Nov 01 08:58:10 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:11 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:11 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc Nov 01 08:58:11 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:11 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f.882d58a0-1275-476f-80d5-3c76325f63fc" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-882d58a0-1275-476f-80d5-3c76325f63fc" released by "_delete_snapshot" :: held 1.632s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" released by "delete_snapshot" :: held 1.665s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:11 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Created reservations ['a366654f-be8b-4518-af85-7512a386a75d', '2a6605ac-1475-43af-ae46-137205c4b04d', '08dc7fba-3973-410e-8ad6-f1a159c0e574', '9e84c672-41af-42ba-81d5-23c8a76530b5'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Delete snapshot completed successfully. Nov 01 08:58:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-115964f9-6c64-449a-8345-fe323760d7ec tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-882d58a0-1275-476f-80d5-3c76325f63fc-delete_snapshot" released by "delete_snapshot" :: held 1.830s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-0ef301d7-321f-47d8-ad6d-e23551a7f88f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-0ef301d7-321f-47d8-ad6d-e23551a7f88f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98c4340-0878-4de2-bc1c-75096cd37eec]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:12 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f Nov 01 08:58:12 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:12 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f" returned: 0 in 0.626s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:12 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f Nov 01 08:58:12 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:13 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0ef301d7-321f-47d8-ad6d-e23551a7f88f" returned: 0 in 0.435s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-quobyte-0ef301d7-321f-47d8-ad6d-e23551a7f88f" released by "delete_volume" :: held 1.153s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Created reservations ['4a548859-0651-429d-b6da-6f558c75fb73', '389bb737-c27c-4783-951f-55bc5a1d67e6', '2ff7370d-d243-4b79-bc5e-afa4553db371', 'b447b277-36bf-40c7-9466-2c7c2c3a6f53'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:13 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:58:13 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:13 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.372s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:58:13 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Deleted volume successfully. Nov 01 08:58:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-82a41227-5ffd-4932-aa1a-3b5bd602f18e tempest-VolumesSnapshotListTestJSON-624627540 None] Lock "cinder-0ef301d7-321f-47d8-ad6d-e23551a7f88f-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Flow 'volume_create_manager' (8b1df47d-0e4c-4692-9f6d-31ede5096f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6de9c7c-932f-4f37-942c-09bb56067b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6de9c7c-932f-4f37-942c-09bb56067b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-604189496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7d4fc7-b909-4fac-ace2-eafb52894c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d63c5481224cc5b2252e3fd8543f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:17Z,use_quota=True,user_id='cb46834c66fb415c95d5519fab351f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c8b42-5c77-4920-bfd0-a26477899bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c8b42-5c77-4920-bfd0-a26477899bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbb7812-1174-4876-8173-df0c5bcb8031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbb7812-1174-4876-8173-df0c5bcb8031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7d4fc7-b909-4fac-ace2-eafb52894c92', 'volume_name': 'volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa531a0-381e-4b28-8763-abf646702f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa531a0-381e-4b28-8763-abf646702f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfea534-fa2c-4e7f-8b36-2b2f3a386d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:17 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Volume cd7d4fc7-b909-4fac-ace2-eafb52894c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92', 'volume_size': 1} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-604189496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7d4fc7-b909-4fac-ace2-eafb52894c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d63c5481224cc5b2252e3fd8543f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:17Z,use_quota=True,user_id='cb46834c66fb415c95d5519fab351f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Creating volume cd7d4fc7-b909-4fac-ace2-eafb52894c92 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:58:17 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:58:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:17 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 1073741824 Nov 01 08:58:17 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:18 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 1073741824" returned: 0 in 0.844s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:18 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 Nov 01 08:58:18 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:19 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92" returned: 0 in 0.562s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfea534-fa2c-4e7f-8b36-2b2f3a386d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659ccc0f-e669-46de-9d7b-5e952d1978c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:19 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Volume volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 (cd7d4fc7-b909-4fac-ace2-eafb52894c92): created successfully Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (659ccc0f-e669-46de-9d7b-5e952d1978c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Flow 'volume_create_manager' (8b1df47d-0e4c-4692-9f6d-31ede5096f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:58:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ef0ffed3-847c-4227-a63a-493377dabd6f tempest-AttachVolumeTestJSON-1502485002 None] Created volume successfully. Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Flow 'volume_create_manager' (e3367dd4-b501-432f-af0f-57bec7f32846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78fcf70-d328-40a3-ae44-553310e69a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78fcf70-d328-40a3-ae44-553310e69a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-130945919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2075d628-b5e3-4267-9b2e-a41d99a204d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89eecf1445bb4024976b02c89eb6594e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:19Z,use_quota=True,user_id='0d59523ef6294caa9add6af84f2a50b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aba0d03-7389-4250-9064-5da58c47e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aba0d03-7389-4250-9064-5da58c47e62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6ca4c2-5de9-461b-b579-127e20fa71d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6ca4c2-5de9-461b-b579-127e20fa71d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2075d628-b5e3-4267-9b2e-a41d99a204d1', 'volume_name': 'volume-2075d628-b5e3-4267-9b2e-a41d99a204d1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0035d4dd-0995-4ac4-88fe-4e0a00748934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0035d4dd-0995-4ac4-88fe-4e0a00748934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19c6c83-839d-4d01-a022-83740eea2140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:19 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Volume 2075d628-b5e3-4267-9b2e-a41d99a204d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2075d628-b5e3-4267-9b2e-a41d99a204d1', 'volume_size': 1} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-130945919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2075d628-b5e3-4267-9b2e-a41d99a204d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89eecf1445bb4024976b02c89eb6594e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:19Z,use_quota=True,user_id='0d59523ef6294caa9add6af84f2a50b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Creating volume 2075d628-b5e3-4267-9b2e-a41d99a204d1 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:58:19 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:58:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:19 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 1073741824 Nov 01 08:58:19 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:20 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 1073741824" returned: 0 in 0.720s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:20 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 Nov 01 08:58:20 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:20 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1" returned: 0 in 0.300s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19c6c83-839d-4d01-a022-83740eea2140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2075d628-b5e3-4267-9b2e-a41d99a204d1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602386e6-81d9-4384-a5f8-acdd0ffb2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:20 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Volume volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 (2075d628-b5e3-4267-9b2e-a41d99a204d1): created successfully Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602386e6-81d9-4384-a5f8-acdd0ffb2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Flow 'volume_create_manager' (e3367dd4-b501-432f-af0f-57bec7f32846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:58:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0d99efc0-11cc-468a-be57-0453dc26dfed tempest-VolumesServicesTestJSON-526207519 None] Created volume successfully. Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-ae7b66d4-0396-47a8-8a03-88ca1fcc4134 req-d0cd6b91-789c-4523-a2ca-5ee706397cd6 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-ae7b66d4-0396-47a8-8a03-88ca1fcc4134 req-d0cd6b91-789c-4523-a2ca-5ee706397cd6 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-ae7b66d4-0396-47a8-8a03-88ca1fcc4134 req-d0cd6b91-789c-4523-a2ca-5ee706397cd6 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-ae7b66d4-0396-47a8-8a03-88ca1fcc4134 req-d0cd6b91-789c-4523-a2ca-5ee706397cd6 tempest-AttachVolumeTestJSON-1502485002 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a49f42b-bfb5-43f5-8f95-743664f6ebeb', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:58:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-ae7b66d4-0396-47a8-8a03-88ca1fcc4134 req-d0cd6b91-789c-4523-a2ca-5ee706397cd6 tempest-AttachVolumeTestJSON-1502485002 None] attachment_update completed successfully. Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:21 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:58:21 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Acquiring lock "cinder-2075d628-b5e3-4267-9b2e-a41d99a204d1-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Lock "cinder-2075d628-b5e3-4267-9b2e-a41d99a204d1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=125,cinder:SELECT=104,cinder:DELETE=9,cinder:INSERT=34 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=128,cinder:UPDATE=115,cinder:INSERT=30,cinder:DELETE=10 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Acquiring lock "cinder-quobyte-2075d628-b5e3-4267-9b2e-a41d99a204d1" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Lock "cinder-quobyte-2075d628-b5e3-4267-9b2e-a41d99a204d1" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba97f5a-ead3-469d-be1b-7595aa82ed9f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:21 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.465s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:58:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:58:21 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 Nov 01 08:58:21 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:22 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1" returned: 0 in 0.490s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:22 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1 Nov 01 08:58:22 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:22 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2075d628-b5e3-4267-9b2e-a41d99a204d1" returned: 0 in 0.277s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Lock "cinder-quobyte-2075d628-b5e3-4267-9b2e-a41d99a204d1" released by "delete_volume" :: held 0.830s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Created reservations ['a3805661-60ba-421c-9d0b-294a8f356eb6', '07f7410b-95ad-4794-8148-47048c3768b1', '56acede8-4324-4a8f-8c2b-72ce39ace9e1', '3071fee6-bbc9-48a3-88b3-daf6a0b0f461'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:22 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:58:22 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:22 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.298s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:22 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:58:22 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Deleted volume successfully. Nov 01 08:58:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-30a5d56a-f061-4677-9d8c-4a1eb0969c23 tempest-VolumesServicesTestJSON-526207519 None] Lock "cinder-2075d628-b5e3-4267-9b2e-a41d99a204d1-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:32 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:58:32 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Flow 'volume_create_manager' (3ed36aef-711a-4ff8-a3e9-2bf609d0bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78795ae3-482a-4aa3-8e4e-cecf4807803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78795ae3-482a-4aa3-8e4e-cecf4807803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-337487521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0001290-4dc6-4288-976e-f96bb8ea2107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fa22596f3e4edb85a7fea6caf5b5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:33Z,use_quota=True,user_id='f9bfa5a1d4ea4758a3bb833563d40faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d88f8b8-938d-420d-a4be-5563c9ce555a),volume_type_id=8d88f8b8-938d-420d-a4be-5563c9ce555a)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf78e830-163e-4ba7-9b6f-9d1ffe374721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf78e830-163e-4ba7-9b6f-9d1ffe374721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bde3788-bd88-4b24-8b75-4fa1e3634cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bde3788-bd88-4b24-8b75-4fa1e3634cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0001290-4dc6-4288-976e-f96bb8ea2107', 'volume_name': 'volume-a0001290-4dc6-4288-976e-f96bb8ea2107', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6199bceb-5af9-43d1-bac8-6c7cbad62ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6199bceb-5af9-43d1-bac8-6c7cbad62ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e4e263-9983-44c4-9735-ab5ccb8c2a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:33 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Volume a0001290-4dc6-4288-976e-f96bb8ea2107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0001290-4dc6-4288-976e-f96bb8ea2107', 'volume_size': 1} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-337487521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0001290-4dc6-4288-976e-f96bb8ea2107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fa22596f3e4edb85a7fea6caf5b5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:33Z,use_quota=True,user_id='f9bfa5a1d4ea4758a3bb833563d40faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d88f8b8-938d-420d-a4be-5563c9ce555a),volume_type_id=8d88f8b8-938d-420d-a4be-5563c9ce555a)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Creating volume a0001290-4dc6-4288-976e-f96bb8ea2107 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:58:33 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:58:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:33 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 1073741824 Nov 01 08:58:33 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:34 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 1073741824" returned: 0 in 1.003s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:34 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 Nov 01 08:58:34 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-a74f4ead-d03f-4a98-8b23-f8f8a9c9bf1b req-c1f92187-fb51-442b-aa75-a531f6db2120 tempest-TestMinimumBasicScenario-709585286 None] Terminate volume connection completed successfully. Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-a74f4ead-d03f-4a98-8b23-f8f8a9c9bf1b req-c1f92187-fb51-442b-aa75-a531f6db2120 tempest-TestMinimumBasicScenario-709585286 None] Deleting attachment 643c25d9-84fa-4c14-b877-122c4565dd09. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:58:35 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107" returned: 0 in 0.401s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e4e263-9983-44c4-9735-ab5ccb8c2a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0001290-4dc6-4288-976e-f96bb8ea2107', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e5ee6a-eefb-45bd-9a40-de9fb9615450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Volume volume-a0001290-4dc6-4288-976e-f96bb8ea2107 (a0001290-4dc6-4288-976e-f96bb8ea2107): created successfully Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e5ee6a-eefb-45bd-9a40-de9fb9615450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Flow 'volume_create_manager' (3ed36aef-711a-4ff8-a3e9-2bf609d0bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:58:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4c3edda0-821a-4420-a1fa-8786072129cd tempest-VolumeTypesAccessTest-1175628192 None] Created volume successfully. Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Acquiring lock "cinder-a0001290-4dc6-4288-976e-f96bb8ea2107-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Lock "cinder-a0001290-4dc6-4288-976e-f96bb8ea2107-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Acquiring lock "cinder-quobyte-a0001290-4dc6-4288-976e-f96bb8ea2107" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Lock "cinder-quobyte-a0001290-4dc6-4288-976e-f96bb8ea2107" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc5534c-d57c-4d87-9bf4-282c463b87f7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Acquiring lock "cinder-6a85af5d-eaeb-41d6-91eb-2e3288116e1f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Lock "cinder-6a85af5d-eaeb-41d6-91eb-2e3288116e1f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:36 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 Nov 01 08:58:36 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Acquiring lock "cinder-quobyte-6a85af5d-eaeb-41d6-91eb-2e3288116e1f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Lock "cinder-quobyte-6a85af5d-eaeb-41d6-91eb-2e3288116e1f" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3d66b1-730f-4df6-afa1-1db0262ddfbb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:36 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f Nov 01 08:58:36 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:36 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107" returned: 0 in 0.669s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:36 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107 Nov 01 08:58:36 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:36 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f" returned: 0 in 0.446s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:36 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f Nov 01 08:58:36 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:36 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a0001290-4dc6-4288-976e-f96bb8ea2107" returned: 0 in 0.282s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Lock "cinder-quobyte-a0001290-4dc6-4288-976e-f96bb8ea2107" released by "delete_volume" :: held 1.045s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:36 devstack cinder-volume[86770]: WARNING cinder.quota [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-893503829 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-893503829, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:58:36 devstack cinder-volume[86770]: WARNING cinder.quota [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-893503829 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-893503829, it is now deprecated. Please use the default quota class for default quota. Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Created reservations ['d0991f9e-8d39-402c-bf8f-60420a692490', 'e556a2f1-6ef6-46ba-ae2d-8ecf441359b1', 'ba084eb1-5810-4b25-9f15-d4fe8b0ad255', '90ec7ef0-cc63-4946-8867-fec858c6f193'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:37 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6a85af5d-eaeb-41d6-91eb-2e3288116e1f" returned: 0 in 0.349s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Lock "cinder-quobyte-6a85af5d-eaeb-41d6-91eb-2e3288116e1f" released by "delete_volume" :: held 0.878s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:37 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:58:37 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Created reservations ['cc980bb8-75bf-4aa8-a67c-951538e1ff06', 'd817be54-4a95-4349-b700-ff4f181ef18c', 'b26773b5-32c8-432c-9929-498dccf23c43', '746ecab5-8988-4675-8f0a-3d736c490f06'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:37 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:58:37 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:37 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.341s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:58:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Deleted volume successfully. Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cccaa98d-28b0-46aa-9fff-1b37ab6d206e tempest-VolumeTypesAccessTest-1175628192 None] Lock "cinder-a0001290-4dc6-4288-976e-f96bb8ea2107-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:37 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.310s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:58:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Deleted volume successfully. Nov 01 08:58:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-331a49e5-8958-4f6b-9d4d-95dd7d86a152 tempest-TestMinimumBasicScenario-709585286 None] Lock "cinder-6a85af5d-eaeb-41d6-91eb-2e3288116e1f-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:58:47 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=20,cinder:INSERT=7,cinder:SELECT=12,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:58:47 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Flow 'volume_create_manager' (69d2f81b-8f66-48f7-a507-340044030f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1246b3-ec91-4892-a397-b24007baad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1246b3-ec91-4892-a397-b24007baad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-200720798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb44c6-4172-4226-9108-2ab7f9316e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f139a00d034971be791d2884b9a5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:55Z,use_quota=True,user_id='0b46b061495f454496930898967c4765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e00c3de-dd75-4f18-92f8-f4377b968bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e00c3de-dd75-4f18-92f8-f4377b968bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3248ce-f242-4d91-bee3-b7968a2eab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:54 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3248ce-f242-4d91-bee3-b7968a2eab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53eb44c6-4172-4226-9108-2ab7f9316e0d', 'volume_name': 'volume-53eb44c6-4172-4226-9108-2ab7f9316e0d', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab24122-6d21-4401-b518-bc4286375350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab24122-6d21-4401-b518-bc4286375350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59109bd6-bdf5-479f-9aac-50c4c0b989dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:58:55 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Volume 53eb44c6-4172-4226-9108-2ab7f9316e0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53eb44c6-4172-4226-9108-2ab7f9316e0d', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Trying to clone 53eb44c6-4172-4226-9108-2ab7f9316e0d from image 2972c011-c2ff-40ad-8107-682efa81840b at location (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 08:58:55 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Image download 20.69 MB at 20.69 MB/s Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5855f6-6fdf-4737-bed8-574881db4c76]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:56 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD Nov 01 08:58:56 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-2f4b1fd1-1c1c-45cc-bafd-93f260567f8a req-bbb01553-44c6-4a12-b58b-f470e79e6659 tempest-AttachVolumeTestJSON-1502485002 None] Terminate volume connection completed successfully. Nov 01 08:58:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2f4b1fd1-1c1c-45cc-bafd-93f260567f8a req-bbb01553-44c6-4a12-b58b-f470e79e6659 tempest-AttachVolumeTestJSON-1502485002 None] Deleting attachment 8a49f42b-bfb5-43f5-8f95-743664f6ebeb. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 08:58:56 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:56 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b is fetched for user 0b46b061495f454496930898967c4765. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 08:58:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d41b0f6-123a-45b4-8882-9fe0a0be795f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:56 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD Nov 01 08:58:56 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:57 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-200720798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb44c6-4172-4226-9108-2ab7f9316e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f139a00d034971be791d2884b9a5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:58:55Z,use_quota=True,user_id='0b46b061495f454496930898967c4765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Creating volume 53eb44c6-4172-4226-9108-2ab7f9316e0d {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:58:57 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:57 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d 1073741824 Nov 01 08:58:57 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:57 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d 1073741824" returned: 0 in 0.678s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:57 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d Nov 01 08:58:57 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:58 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d" returned: 0 in 0.302s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Attempting download of 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume 53eb44c6-4172-4226-9108-2ab7f9316e0d. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6d9ea-4d3a-41d2-a6b3-7b38fbdc7860]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dky9kx_f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:58 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dky9kx_f Nov 01 08:58:58 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:58 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dky9kx_f" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dky9kx_f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:58 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dky9kx_f Nov 01 08:58:58 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:59 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dky9kx_f" returned: 1 in 0.409s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dky9kx_f' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 08:58:59 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[57352bf9-bf34-4822-b2f0-c79b7804d9ae]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:58:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:59 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD Nov 01 08:58:59 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:58:59 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Nov 01 08:58:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:58:59 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] 2972c011-c2ff-40ad-8107-682efa81840b was qcow2, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 08:58:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:58:59 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d Nov 01 08:58:59 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:02 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d" returned: 0 in 3.166s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:02 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_r8p6cabydevstack@QuobyteHD, size 112.00 MB, duration 3.17 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 08:59:02 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Converted 112.00 MB image at 35.36 MB/s Nov 01 08:59:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:02 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d 1G Nov 01 08:59:02 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:03 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d 1G" returned: 0 in 0.660s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Downloaded image 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume 53eb44c6-4172-4226-9108-2ab7f9316e0d successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b for user 0b46b061495f454496930898967c4765 is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Marking volume 53eb44c6-4172-4226-9108-2ab7f9316e0d as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Copying metadata from image 2972c011-c2ff-40ad-8107-682efa81840b to 53eb44c6-4172-4226-9108-2ab7f9316e0d. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Creating volume glance metadata for volume 53eb44c6-4172-4226-9108-2ab7f9316e0d backed by image 2972c011-c2ff-40ad-8107-682efa81840b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59109bd6-bdf5-479f-9aac-50c4c0b989dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53eb44c6-4172-4226-9108-2ab7f9316e0d', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f4e73c-45ac-40c7-a524-9df8edfb7f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:03 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Volume volume-53eb44c6-4172-4226-9108-2ab7f9316e0d (53eb44c6-4172-4226-9108-2ab7f9316e0d): created successfully Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f4e73c-45ac-40c7-a524-9df8edfb7f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Flow 'volume_create_manager' (69d2f81b-8f66-48f7-a507-340044030f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:59:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-aefbb2f3-fb5c-436f-90bd-2aab947d3662 tempest-TestShelveInstance-454297867 None] Created volume successfully. Nov 01 08:59:13 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=11 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:59:13 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=5,cinder:SELECT=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:59:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-a6ffa3a8-c15d-4ea2-8dde-13ffcf1cbd8e req-57ddf5c8-ad68-48ac-9ecf-af195c954658 tempest-TestShelveInstance-454297867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-a6ffa3a8-c15d-4ea2-8dde-13ffcf1cbd8e req-57ddf5c8-ad68-48ac-9ecf-af195c954658 tempest-TestShelveInstance-454297867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-a6ffa3a8-c15d-4ea2-8dde-13ffcf1cbd8e req-57ddf5c8-ad68-48ac-9ecf-af195c954658 tempest-TestShelveInstance-454297867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-a6ffa3a8-c15d-4ea2-8dde-13ffcf1cbd8e req-57ddf5c8-ad68-48ac-9ecf-af195c954658 tempest-TestShelveInstance-454297867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-53eb44c6-4172-4226-9108-2ab7f9316e0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4b7d2f8-d425-455a-aefd-1cf1834904df', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 08:59:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-a6ffa3a8-c15d-4ea2-8dde-13ffcf1cbd8e req-57ddf5c8-ad68-48ac-9ecf-af195c954658 tempest-TestShelveInstance-454297867 None] attachment_update completed successfully. Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:21 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:59:21 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:21 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.480s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 08:59:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 08:59:29 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:59:29 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 08:59:35 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Flow 'volume_create_manager' (74db28ff-9f2d-4023-88c5-e84ea792ae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e37c605-ed8f-4343-a132-ea7ce44806cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e37c605-ed8f-4343-a132-ea7ce44806cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-849749492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c76190-ec44-4652-92db-e53cf25c2360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f6cb8bbcac431f8919f035bc45c537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:59:36Z,use_quota=True,user_id='3be8a6c87cdb4e7e8fd35d59d1e9f0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a3e033-fcbd-45ce-86e0-9d74a54ff913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a3e033-fcbd-45ce-86e0-9d74a54ff913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfbf4b6-6af0-44e7-8d60-697c38fb3005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfbf4b6-6af0-44e7-8d60-697c38fb3005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c76190-ec44-4652-92db-e53cf25c2360', 'volume_name': 'volume-c6c76190-ec44-4652-92db-e53cf25c2360', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2c455-4908-4336-8833-2f93f1584b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2c455-4908-4336-8833-2f93f1584b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8459dd1-8fd4-4b18-a79e-b45b02c26c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Volume c6c76190-ec44-4652-92db-e53cf25c2360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c76190-ec44-4652-92db-e53cf25c2360', 'volume_size': 1} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-849749492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c76190-ec44-4652-92db-e53cf25c2360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f6cb8bbcac431f8919f035bc45c537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:59:36Z,use_quota=True,user_id='3be8a6c87cdb4e7e8fd35d59d1e9f0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Creating volume c6c76190-ec44-4652-92db-e53cf25c2360 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:59:36 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:59:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:36 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 1073741824 Nov 01 08:59:36 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Flow 'volume_create_manager' (22761a78-c435-4c7a-be76-0d24dd676c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f05ece4-7c4f-45b1-b757-6acd353e930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f05ece4-7c4f-45b1-b757-6acd353e930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1104653518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bc5046-9a0e-422a-a8dd-232020f99220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f6cb8bbcac431f8919f035bc45c537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:59:37Z,use_quota=True,user_id='3be8a6c87cdb4e7e8fd35d59d1e9f0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5a1087-e273-42ba-be46-fc2a2aa1dacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5a1087-e273-42ba-be46-fc2a2aa1dacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437f48fb-45b6-4e0d-b667-a450724d71a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437f48fb-45b6-4e0d-b667-a450724d71a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6bc5046-9a0e-422a-a8dd-232020f99220', 'volume_name': 'volume-f6bc5046-9a0e-422a-a8dd-232020f99220', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd0aaa0-800c-46e5-ae32-ac7027180c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd0aaa0-800c-46e5-ae32-ac7027180c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9161ba5f-b8e8-4bb0-9f78-19de332e321e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:37 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Volume f6bc5046-9a0e-422a-a8dd-232020f99220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6bc5046-9a0e-422a-a8dd-232020f99220', 'volume_size': 1} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:37 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 1073741824" returned: 0 in 1.091s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:37 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 Nov 01 08:59:37 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:37 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360" returned: 0 in 0.443s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1104653518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bc5046-9a0e-422a-a8dd-232020f99220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66f6cb8bbcac431f8919f035bc45c537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:59:37Z,use_quota=True,user_id='3be8a6c87cdb4e7e8fd35d59d1e9f0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Creating volume f6bc5046-9a0e-422a-a8dd-232020f99220 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:59:37 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:59:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8459dd1-8fd4-4b18-a79e-b45b02c26c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c76190-ec44-4652-92db-e53cf25c2360', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:38 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 1073741824 Nov 01 08:59:38 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dd3fdb-ac3e-4b12-bd45-16a10d678718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:38 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Volume volume-c6c76190-ec44-4652-92db-e53cf25c2360 (c6c76190-ec44-4652-92db-e53cf25c2360): created successfully Nov 01 08:59:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dd3fdb-ac3e-4b12-bd45-16a10d678718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Flow 'volume_create_manager' (74db28ff-9f2d-4023-88c5-e84ea792ae45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:59:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c3998b52-61f1-453c-bfce-dbd07662a459 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Created volume successfully. Nov 01 08:59:38 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 1073741824" returned: 0 in 0.973s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:39 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 Nov 01 08:59:39 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:39 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:59:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9161ba5f-b8e8-4bb0-9f78-19de332e321e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6bc5046-9a0e-422a-a8dd-232020f99220', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59a4a95-936a-4833-a920-1badee468645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:39 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Volume volume-f6bc5046-9a0e-422a-a8dd-232020f99220 (f6bc5046-9a0e-422a-a8dd-232020f99220): created successfully Nov 01 08:59:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59a4a95-936a-4833-a920-1badee468645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Flow 'volume_create_manager' (22761a78-c435-4c7a-be76-0d24dd676c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:59:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-79b1bd5c-0124-4a6f-8c20-b4f5baa8ab3c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Created volume successfully. Nov 01 08:59:48 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 08:59:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (cb015a93-b9f0-49ec-bff4-28ac877f7359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:59:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d4dc8-2784-43f6-9656-a891359e08fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251d4dc8-2784-43f6-9656-a891359e08fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142933111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab70e105-bb19-4964-b3ab-8fc9b0640cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:59:49Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a2216e-f9f3-44d5-9f55-4e7c85089ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a2216e-f9f3-44d5-9f55-4e7c85089ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f4743d-e69b-41c7-8684-9aef422bc5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f4743d-e69b-41c7-8684-9aef422bc5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab70e105-bb19-4964-b3ab-8fc9b0640cd7', 'volume_name': 'volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce607b6b-2141-496d-ad8d-c4c160db184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce607b6b-2141-496d-ad8d-c4c160db184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617951ac-22cd-4ad4-9f17-6606c95d9b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Volume ab70e105-bb19-4964-b3ab-8fc9b0640cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7', 'volume_size': 1} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142933111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab70e105-bb19-4964-b3ab-8fc9b0640cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T07:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T07:59:49Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Creating volume ab70e105-bb19-4964-b3ab-8fc9b0640cd7 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 08:59:49 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:49 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 1073741824 Nov 01 08:59:49 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:49 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 1073741824" returned: 0 in 0.835s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:50 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 Nov 01 08:59:50 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:50 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" returned: 0 in 0.790s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617951ac-22cd-4ad4-9f17-6606c95d9b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3609b6b9-03c4-414e-a6b9-22af0d51d252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 08:59:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Volume volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 (ab70e105-bb19-4964-b3ab-8fc9b0640cd7): created successfully Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3609b6b9-03c4-414e-a6b9-22af0d51d252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 08:59:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (cb015a93-b9f0-49ec-bff4-28ac877f7359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 08:59:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2d3c8e2d-26b9-4cf7-b8f4-2f9f2658e6c0 tempest-VolumesActionsTest-709951013 None] Created volume successfully. Nov 01 08:59:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-77f2f580-8455-49e7-a539-b4842e728ef1 tempest-VolumesActionsTest-709951013 None] Acquiring lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" by "attach_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:59:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-77f2f580-8455-49e7-a539-b4842e728ef1 tempest-VolumesActionsTest-709951013 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" acquired by "attach_volume" :: waited 0.060s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:59:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-77f2f580-8455-49e7-a539-b4842e728ef1 tempest-VolumesActionsTest-709951013 None] Attaching volume ab70e105-bb19-4964-b3ab-8fc9b0640cd7 to instance e0382f41-1546-43e9-9077-894ea1cca380 at mountpoint /dev/vdb on host None. Nov 01 08:59:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-77f2f580-8455-49e7-a539-b4842e728ef1 tempest-VolumesActionsTest-709951013 None] Attach volume completed successfully. Nov 01 08:59:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-77f2f580-8455-49e7-a539-b4842e728ef1 tempest-VolumesActionsTest-709951013 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" released by "attach_volume" :: held 0.387s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:59:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b1b0721f-ff23-4237-8f5b-ad1a0a49e72d tempest-VolumesActionsTest-100865241 None] Terminate volume connection completed successfully. Nov 01 08:59:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1b0721f-ff23-4237-8f5b-ad1a0a49e72d tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-detach_volume" by "detach_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:59:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1b0721f-ff23-4237-8f5b-ad1a0a49e72d tempest-VolumesActionsTest-100865241 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:59:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b1b0721f-ff23-4237-8f5b-ad1a0a49e72d tempest-VolumesActionsTest-100865241 None] Detaching volume ab70e105-bb19-4964-b3ab-8fc9b0640cd7 from instance e0382f41-1546-43e9-9077-894ea1cca380. Nov 01 08:59:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b1b0721f-ff23-4237-8f5b-ad1a0a49e72d tempest-VolumesActionsTest-100865241 None] Detach volume completed successfully. Nov 01 08:59:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b1b0721f-ff23-4237-8f5b-ad1a0a49e72d tempest-VolumesActionsTest-100865241 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-detach_volume" released by "detach_volume" :: held 0.161s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:59:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-350e8553-103e-4cf7-9688-ea16b6de1190 tempest-VolumesActionsTest-709951013 None] Acquiring lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-detach_volume" by "detach_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:59:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-350e8553-103e-4cf7-9688-ea16b6de1190 tempest-VolumesActionsTest-709951013 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:59:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-350e8553-103e-4cf7-9688-ea16b6de1190 tempest-VolumesActionsTest-709951013 None] Volume detach called, but volume not attached. Nov 01 08:59:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-350e8553-103e-4cf7-9688-ea16b6de1190 tempest-VolumesActionsTest-709951013 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:59:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Acquiring lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:59:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:59:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Acquiring lock "cinder-quobyte-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 08:59:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Lock "cinder-quobyte-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" acquired by "delete_volume" :: waited 0.051s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 08:59:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29630d8-ad08-4c9c-ae6c-6b0589996a62]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 08:59:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:56 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 Nov 01 08:59:56 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:56 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" returned: 0 in 0.714s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:56 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7 Nov 01 08:59:56 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:57 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" returned: 0 in 0.411s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Lock "cinder-quobyte-ab70e105-bb19-4964-b3ab-8fc9b0640cd7" released by "delete_volume" :: held 1.202s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Created reservations ['3a4d9187-ce49-4e6c-be49-b9a14050ef65', '53da9aa6-7c01-4186-b43f-a192966d1e1c', '994fd318-d997-431c-9cc6-c70097ff70f4', 'e4314046-6691-45fd-b890-607f38e55757'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 08:59:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 08:59:57 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 08:59:57 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 08:59:58 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Nov 01 08:59:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.610s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 08:59:58 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 08:59:58 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Deleted volume successfully. Nov 01 08:59:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1b52f0f7-dd44-4bef-bf5b-3b50b16f7494 tempest-VolumesActionsTest-709951013 None] Lock "cinder-ab70e105-bb19-4964-b3ab-8fc9b0640cd7-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (61675c83-b6ef-4a68-b477-093d9f4e2ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ddd4a7-1caa-456d-bd4e-bd2a434fa42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9ddd4a7-1caa-456d-bd4e-bd2a434fa42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315835692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47e8856-2bc4-405c-a716-2d4fb582798a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:06Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd5f6b6-2bf9-4463-b016-59acf6c0a10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd5f6b6-2bf9-4463-b016-59acf6c0a10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d6a1c9-abdc-4bec-af3e-04424b628848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d6a1c9-abdc-4bec-af3e-04424b628848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47e8856-2bc4-405c-a716-2d4fb582798a', 'volume_name': 'volume-e47e8856-2bc4-405c-a716-2d4fb582798a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca898c1c-02af-4e8b-a537-8779fdf11bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca898c1c-02af-4e8b-a537-8779fdf11bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e17e11-5e59-4e27-b192-efb2084738e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:06 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Volume e47e8856-2bc4-405c-a716-2d4fb582798a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47e8856-2bc4-405c-a716-2d4fb582798a', 'volume_size': 1} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1315835692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47e8856-2bc4-405c-a716-2d4fb582798a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:06Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Creating volume e47e8856-2bc4-405c-a716-2d4fb582798a {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:06 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:06 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a 1073741824 Nov 01 09:00:06 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:07 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a 1073741824" returned: 0 in 1.139s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:08 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a Nov 01 09:00:08 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:08 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a" returned: 0 in 0.497s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e17e11-5e59-4e27-b192-efb2084738e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47e8856-2bc4-405c-a716-2d4fb582798a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc20e24-7792-43da-8a5b-26f3a2a0476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:08 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Volume volume-e47e8856-2bc4-405c-a716-2d4fb582798a (e47e8856-2bc4-405c-a716-2d4fb582798a): created successfully Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc20e24-7792-43da-8a5b-26f3a2a0476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (61675c83-b6ef-4a68-b477-093d9f4e2ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-732be82f-2bc6-4efa-ae54-1f8e9b0e96c3 tempest-VolumesActionsTest-709951013 None] Created volume successfully. Nov 01 09:00:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-e47e8856-2bc4-405c-a716-2d4fb582798a-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Lock "cinder-e47e8856-2bc4-405c-a716-2d4fb582798a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-quobyte-e47e8856-2bc4-405c-a716-2d4fb582798a" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-e47e8856-2bc4-405c-a716-2d4fb582798a" acquired by "delete_volume" :: waited 0.080s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15d831f-2340-4895-8e8a-8774b11cd2fc]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:10 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a Nov 01 09:00:10 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-738eedba-c0a2-41f4-a8f0-3adca2a115a5 req-0468ef9e-0287-4e70-b3f2-44d96accb6a6 tempest-TestShelveInstance-454297867 None] Terminate volume connection completed successfully. Nov 01 09:00:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-738eedba-c0a2-41f4-a8f0-3adca2a115a5 req-0468ef9e-0287-4e70-b3f2-44d96accb6a6 tempest-TestShelveInstance-454297867 None] Deleting attachment f4b7d2f8-d425-455a-aefd-1cf1834904df. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:00:11 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a" returned: 0 in 0.771s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:11 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a Nov 01 09:00:11 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:11 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e47e8856-2bc4-405c-a716-2d4fb582798a" returned: 0 in 0.438s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-e47e8856-2bc4-405c-a716-2d4fb582798a" released by "delete_volume" :: held 1.364s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Created reservations ['4df8cb1a-150f-4dd8-a187-714699d2e4e2', 'f64ab176-9de9-497c-bdb5-4b921ca506b9', '3fd8f983-2119-42df-bf44-f9be41a56b72', 'd0dd5c16-4146-4315-9a56-004fd1552dfd'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:11 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:11 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:11 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.261s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:11 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Deleted volume successfully. Nov 01 09:00:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dd0c52ae-38f1-4e59-ae61-db9b9b28c71e tempest-VolumesActionsTest-100865241 None] Lock "cinder-e47e8856-2bc4-405c-a716-2d4fb582798a-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (06e80e6b-abb2-4013-ad3b-c907be775baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89f875d-023c-467e-ad91-baf2953cce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89f875d-023c-467e-ad91-baf2953cce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-880017145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc44639-eed4-4c45-9402-3399ceaf749c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:13Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eda11e7-4647-4f76-9962-7cf7ffb6cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eda11e7-4647-4f76-9962-7cf7ffb6cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965a1cdb-3704-4bc0-abbf-d67346bc0603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965a1cdb-3704-4bc0-abbf-d67346bc0603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc44639-eed4-4c45-9402-3399ceaf749c', 'volume_name': 'volume-afc44639-eed4-4c45-9402-3399ceaf749c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0707b2e0-67ab-4e12-b285-4e371cd19460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0707b2e0-67ab-4e12-b285-4e371cd19460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9e4c85-0eda-48cd-9a37-08efd5c602b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:13 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Volume afc44639-eed4-4c45-9402-3399ceaf749c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc44639-eed4-4c45-9402-3399ceaf749c', 'volume_size': 1} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-880017145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc44639-eed4-4c45-9402-3399ceaf749c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:13Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Creating volume afc44639-eed4-4c45-9402-3399ceaf749c {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:13 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:13 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c 1073741824 Nov 01 09:00:13 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-37279003-457a-4223-b546-2edfc2964028 req-05c87160-a1a6-406c-81cd-b29cd25a7ecc tempest-TestShelveInstance-454297867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:14 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c 1073741824" returned: 0 in 0.518s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:14 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c Nov 01 09:00:14 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:14 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c" returned: 0 in 0.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-37279003-457a-4223-b546-2edfc2964028 req-05c87160-a1a6-406c-81cd-b29cd25a7ecc tempest-TestShelveInstance-454297867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.688s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9e4c85-0eda-48cd-9a37-08efd5c602b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc44639-eed4-4c45-9402-3399ceaf749c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b445c1-b286-42c0-83d7-575c2a3d7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-37279003-457a-4223-b546-2edfc2964028 req-05c87160-a1a6-406c-81cd-b29cd25a7ecc tempest-TestShelveInstance-454297867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:14 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Volume volume-afc44639-eed4-4c45-9402-3399ceaf749c (afc44639-eed4-4c45-9402-3399ceaf749c): created successfully Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b445c1-b286-42c0-83d7-575c2a3d7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (06e80e6b-abb2-4013-ad3b-c907be775baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:14 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9c587b7d-f69a-43a4-b4f0-9dd5ee3f40a2 tempest-VolumesActionsTest-709951013 None] Created volume successfully. Nov 01 09:00:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-37279003-457a-4223-b546-2edfc2964028 req-05c87160-a1a6-406c-81cd-b29cd25a7ecc tempest-TestShelveInstance-454297867 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-53eb44c6-4172-4226-9108-2ab7f9316e0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '991b70f1-5a05-4359-9604-c68d5357a953', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:00:14 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-37279003-457a-4223-b546-2edfc2964028 req-05c87160-a1a6-406c-81cd-b29cd25a7ecc tempest-TestShelveInstance-454297867 None] attachment_update completed successfully. Nov 01 09:00:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-afc44639-eed4-4c45-9402-3399ceaf749c-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Lock "cinder-afc44639-eed4-4c45-9402-3399ceaf749c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-quobyte-afc44639-eed4-4c45-9402-3399ceaf749c" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-afc44639-eed4-4c45-9402-3399ceaf749c" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c549f00-965d-49c5-b94f-f8d91860d652]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:16 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c Nov 01 09:00:16 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:16 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c" returned: 0 in 0.419s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:16 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c Nov 01 09:00:16 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:16 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc44639-eed4-4c45-9402-3399ceaf749c" returned: 0 in 0.302s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-afc44639-eed4-4c45-9402-3399ceaf749c" released by "delete_volume" :: held 0.773s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Created reservations ['c9b48d2a-c6e7-4ee4-8b92-1af0f8c92adc', 'a0bdda88-2c0d-4838-900e-3aaf318be372', 'febc2957-1a97-4a8b-8641-0264c8b841c2', 'c8031ff2-d5d9-406a-805e-4bfe9ecf3804'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:16 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:16 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:17 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.399s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Deleted volume successfully. Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ce5b610-4c5f-4b09-b156-32f5b465a017 tempest-VolumesActionsTest-100865241 None] Lock "cinder-afc44639-eed4-4c45-9402-3399ceaf749c-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (e54e079c-2ce8-42b1-aa0a-e975114d75d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab8d38f-c1d3-4af3-abec-c071d80f5cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab8d38f-c1d3-4af3-abec-c071d80f5cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-761570070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd5cb75-209a-4ceb-8c70-83c46feecc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:18Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89ce3f7-c768-4df3-ac73-2b6d5b291ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89ce3f7-c768-4df3-ac73-2b6d5b291ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a694dfd-0f3f-430f-84b7-e4112d99a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a694dfd-0f3f-430f-84b7-e4112d99a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd5cb75-209a-4ceb-8c70-83c46feecc0f', 'volume_name': 'volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f672178-5b5c-4182-8ee4-bdd1e9e0e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f672178-5b5c-4182-8ee4-bdd1e9e0e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200925be-cb21-4b89-a0a8-c192a687451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:17 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Volume edd5cb75-209a-4ceb-8c70-83c46feecc0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f', 'volume_size': 1} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-761570070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd5cb75-209a-4ceb-8c70-83c46feecc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:18Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Creating volume edd5cb75-209a-4ceb-8c70-83c46feecc0f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:17 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:17 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f 1073741824 Nov 01 09:00:17 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:18 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f 1073741824" returned: 0 in 0.779s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:18 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f Nov 01 09:00:18 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:19 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f" returned: 0 in 0.393s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200925be-cb21-4b89-a0a8-c192a687451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3466ff-7725-48df-a63d-6942895ad087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:19 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Volume volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f (edd5cb75-209a-4ceb-8c70-83c46feecc0f): created successfully Nov 01 09:00:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3466ff-7725-48df-a63d-6942895ad087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (e54e079c-2ce8-42b1-aa0a-e975114d75d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-52b39306-0704-492c-8f6d-9f5c51fef1ba tempest-VolumesActionsTest-709951013 None] Created volume successfully. Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-edd5cb75-209a-4ceb-8c70-83c46feecc0f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Lock "cinder-edd5cb75-209a-4ceb-8c70-83c46feecc0f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-quobyte-edd5cb75-209a-4ceb-8c70-83c46feecc0f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-edd5cb75-209a-4ceb-8c70-83c46feecc0f" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[556b7f68-95ab-4e3a-af26-48bb89a94655]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:20 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f Nov 01 09:00:20 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:20 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:20 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f Nov 01 09:00:20 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:20 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-edd5cb75-209a-4ceb-8c70-83c46feecc0f" returned: 0 in 0.279s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-edd5cb75-209a-4ceb-8c70-83c46feecc0f" released by "delete_volume" :: held 0.713s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Created reservations ['9d62d0c4-6243-4971-b78f-e8fb4dea74f1', '98d00711-0499-4ad2-b8ff-2aba6e232fa9', '62dcaf86-4b64-48dc-8627-61c95e6062b9', 'f89b90a1-e7e7-48c8-b213-867c333a90fb'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:20 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:20 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:21 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.312s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:21 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Deleted volume successfully. Nov 01 09:00:21 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:21 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ab38052-e131-4d72-ac07-cdd5d86a6a2b tempest-VolumesActionsTest-100865241 None] Lock "cinder-edd5cb75-209a-4ceb-8c70-83c46feecc0f-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:21 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.355s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (a3489678-a13d-4077-bb11-a63f37979eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a60671-5a8f-4195-a5cb-43377b1da6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a60671-5a8f-4195-a5cb-43377b1da6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847193074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08c5195-2713-4ce9-9329-17e71585fa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:22Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e768453a-f4cf-4a6d-91df-b0617516f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e768453a-f4cf-4a6d-91df-b0617516f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14914139-5894-4085-b7d3-d5fd7b05e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14914139-5894-4085-b7d3-d5fd7b05e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08c5195-2713-4ce9-9329-17e71585fa0a', 'volume_name': 'volume-d08c5195-2713-4ce9-9329-17e71585fa0a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cbbe47-d355-46eb-b0a2-7bc440587d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cbbe47-d355-46eb-b0a2-7bc440587d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbf3ece-1a65-475b-899b-d40a7fb02cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:21 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Volume d08c5195-2713-4ce9-9329-17e71585fa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08c5195-2713-4ce9-9329-17e71585fa0a', 'volume_size': 1} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847193074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08c5195-2713-4ce9-9329-17e71585fa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:22Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Creating volume d08c5195-2713-4ce9-9329-17e71585fa0a {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:22 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:22 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a 1073741824 Nov 01 09:00:22 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:22 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a 1073741824" returned: 0 in 0.541s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:22 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a Nov 01 09:00:22 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:22 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a" returned: 0 in 0.297s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbf3ece-1a65-475b-899b-d40a7fb02cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08c5195-2713-4ce9-9329-17e71585fa0a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e09f6b-e508-4c5d-9603-da0aa73172b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:22 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Volume volume-d08c5195-2713-4ce9-9329-17e71585fa0a (d08c5195-2713-4ce9-9329-17e71585fa0a): created successfully Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e09f6b-e508-4c5d-9603-da0aa73172b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (a3489678-a13d-4077-bb11-a63f37979eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:22 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a674aa5d-8318-4be9-a7a6-6205b80421ec tempest-VolumesActionsTest-709951013 None] Created volume successfully. Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-d08c5195-2713-4ce9-9329-17e71585fa0a-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Lock "cinder-d08c5195-2713-4ce9-9329-17e71585fa0a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Acquiring lock "cinder-quobyte-d08c5195-2713-4ce9-9329-17e71585fa0a" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-d08c5195-2713-4ce9-9329-17e71585fa0a" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21878a2-06a7-4403-a596-83f88f5fb960]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:24 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a Nov 01 09:00:24 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:24 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a" returned: 0 in 0.408s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:24 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a Nov 01 09:00:24 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:25 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d08c5195-2713-4ce9-9329-17e71585fa0a" returned: 0 in 0.351s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Lock "cinder-quobyte-d08c5195-2713-4ce9-9329-17e71585fa0a" released by "delete_volume" :: held 0.803s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Created reservations ['e307e317-99ab-4abc-97d5-b3cfc37085cc', '87f1993e-1090-4f87-a413-aa5643135663', 'e11f2276-d10c-4968-bd7f-cd920f2d439d', 'c99c8c09-d4fd-4e98-beac-ca11b9342c87'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:25 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:25 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:25 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Deleted volume successfully. Nov 01 09:00:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1266d7df-f703-4b77-9d1c-b0807fb54f62 tempest-VolumesActionsTest-100865241 None] Lock "cinder-d08c5195-2713-4ce9-9329-17e71585fa0a-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Flow 'volume_create_manager' (d3ffab3c-86f2-4175-aa36-d32b9788d172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f44b188-e92c-419a-8e26-dae587d148c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f44b188-e92c-419a-8e26-dae587d148c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-374380441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b17187-6f85-443b-aab7-be0c56e71767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d63c5481224cc5b2252e3fd8543f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:26Z,use_quota=True,user_id='cb46834c66fb415c95d5519fab351f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c0fabc-9e93-456c-8d33-ba34e9a5d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c0fabc-9e93-456c-8d33-ba34e9a5d903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d73eefb-8e5c-4117-91a1-2726be3ad8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d73eefb-8e5c-4117-91a1-2726be3ad8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b17187-6f85-443b-aab7-be0c56e71767', 'volume_name': 'volume-42b17187-6f85-443b-aab7-be0c56e71767', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25fe540-f973-4ac0-9c19-59d0c227b1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25fe540-f973-4ac0-9c19-59d0c227b1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94e4ba4-1168-42e6-b93c-55eef27eecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Volume 42b17187-6f85-443b-aab7-be0c56e71767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b17187-6f85-443b-aab7-be0c56e71767', 'volume_size': 1} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-374380441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b17187-6f85-443b-aab7-be0c56e71767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d63c5481224cc5b2252e3fd8543f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:26Z,use_quota=True,user_id='cb46834c66fb415c95d5519fab351f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Creating volume 42b17187-6f85-443b-aab7-be0c56e71767 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:26 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:26 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 1073741824 Nov 01 09:00:26 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:27 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 1073741824" returned: 0 in 0.580s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:27 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 Nov 01 09:00:27 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (b8627aa6-b85c-40de-80c5-ca9955cdc958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aed691-f2e8-4410-9315-541e6bc113a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aed691-f2e8-4410-9315-541e6bc113a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1760114576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8100801f-f256-424b-9104-d8d9fb0dd2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:27Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026104ad-fee3-4ddb-aa3f-29f28e39bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026104ad-fee3-4ddb-aa3f-29f28e39bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1359e7de-e994-4074-9d52-5264fbff1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1359e7de-e994-4074-9d52-5264fbff1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8100801f-f256-424b-9104-d8d9fb0dd2a8', 'volume_name': 'volume-8100801f-f256-424b-9104-d8d9fb0dd2a8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81ba11-910e-418f-be8c-218bd2bceecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c81ba11-910e-418f-be8c-218bd2bceecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f64f433-ab1c-43e0-911a-8a5c2394d238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Volume 8100801f-f256-424b-9104-d8d9fb0dd2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8100801f-f256-424b-9104-d8d9fb0dd2a8', 'volume_size': 1} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:27 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767" returned: 0 in 0.345s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.080s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1760114576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8100801f-f256-424b-9104-d8d9fb0dd2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196d0879c32042488a942e0ec969932f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:27Z,use_quota=True,user_id='ecae3d544e2d4927840574b210212fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Creating volume 8100801f-f256-424b-9104-d8d9fb0dd2a8 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:27 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94e4ba4-1168-42e6-b93c-55eef27eecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b17187-6f85-443b-aab7-be0c56e71767', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecc05f6-af03-47ba-9462-938ac47c29eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:27 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 1073741824 Nov 01 09:00:27 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Volume volume-42b17187-6f85-443b-aab7-be0c56e71767 (42b17187-6f85-443b-aab7-be0c56e71767): created successfully Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecc05f6-af03-47ba-9462-938ac47c29eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Flow 'volume_create_manager' (d3ffab3c-86f2-4175-aa36-d32b9788d172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-05e4d53e-75ab-4318-9648-75dd851100c6 tempest-AttachVolumeTestJSON-1502485002 None] Created volume successfully. Nov 01 09:00:27 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 1073741824" returned: 0 in 0.502s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:28 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 Nov 01 09:00:28 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:28 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8" returned: 0 in 0.294s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f64f433-ab1c-43e0-911a-8a5c2394d238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8100801f-f256-424b-9104-d8d9fb0dd2a8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4850f3fb-3d0c-48e5-834b-4c07e3543e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Volume volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 (8100801f-f256-424b-9104-d8d9fb0dd2a8): created successfully Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4850f3fb-3d0c-48e5-834b-4c07e3543e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Flow 'volume_create_manager' (b8627aa6-b85c-40de-80c5-ca9955cdc958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d0cd25aa-a6d5-4e4b-b305-eb8ee2dcbc8e tempest-VolumesActionsTest-709951013 None] Created volume successfully. Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-3a87b1f7-5cfe-41ec-a721-cf170ca7cd05 req-d5230fc6-51ba-4491-91e9-140c35c2fcfb tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-3a87b1f7-5cfe-41ec-a721-cf170ca7cd05 req-d5230fc6-51ba-4491-91e9-140c35c2fcfb tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-3a87b1f7-5cfe-41ec-a721-cf170ca7cd05 req-d5230fc6-51ba-4491-91e9-140c35c2fcfb tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-3a87b1f7-5cfe-41ec-a721-cf170ca7cd05 req-d5230fc6-51ba-4491-91e9-140c35c2fcfb tempest-TestServerVolumeAttachmentScenario-1663430955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-c6c76190-ec44-4652-92db-e53cf25c2360', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81af3a8c-e582-4d67-bd2a-b2dc7652d0b0', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:00:29 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-3a87b1f7-5cfe-41ec-a721-cf170ca7cd05 req-d5230fc6-51ba-4491-91e9-140c35c2fcfb tempest-TestServerVolumeAttachmentScenario-1663430955 None] attachment_update completed successfully. Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-75a7ce1a-70b8-42cb-84b1-4e7ea26a4420 req-3c829f44-03fe-43b1-bac7-a1003ccf372a tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-75a7ce1a-70b8-42cb-84b1-4e7ea26a4420 req-3c829f44-03fe-43b1-bac7-a1003ccf372a tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-75a7ce1a-70b8-42cb-84b1-4e7ea26a4420 req-3c829f44-03fe-43b1-bac7-a1003ccf372a tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-75a7ce1a-70b8-42cb-84b1-4e7ea26a4420 req-3c829f44-03fe-43b1-bac7-a1003ccf372a tempest-AttachVolumeTestJSON-1502485002 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-42b17187-6f85-443b-aab7-be0c56e71767', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a88a208d-1394-4f62-a648-dad2236c1783', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=70,cinder:UPDATE=80,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:00:29 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=68,cinder:UPDATE=70,cinder:INSERT=15,cinder:DELETE=8 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:00:29 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-75a7ce1a-70b8-42cb-84b1-4e7ea26a4420 req-3c829f44-03fe-43b1-bac7-a1003ccf372a tempest-AttachVolumeTestJSON-1502485002 None] attachment_update completed successfully. Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Acquiring lock "cinder-8100801f-f256-424b-9104-d8d9fb0dd2a8-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Lock "cinder-8100801f-f256-424b-9104-d8d9fb0dd2a8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Acquiring lock "cinder-quobyte-8100801f-f256-424b-9104-d8d9fb0dd2a8" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Lock "cinder-quobyte-8100801f-f256-424b-9104-d8d9fb0dd2a8" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79e39dd-8c62-448c-9520-224656487ee4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:30 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 Nov 01 09:00:30 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:30 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:30 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8 Nov 01 09:00:30 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:31 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8100801f-f256-424b-9104-d8d9fb0dd2a8" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Lock "cinder-quobyte-8100801f-f256-424b-9104-d8d9fb0dd2a8" released by "delete_volume" :: held 0.692s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Created reservations ['093ada6f-58bb-4dd3-9632-6ee0dbf430cd', 'c3b2b4b0-ccb6-44fc-9e92-8c404e81812f', '036b9066-b232-4437-a291-1f2011fa7ab3', '4edebfd6-f9cb-4ea3-a992-dcb0c9966e6f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:31 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:31 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:31 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.338s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Deleted volume successfully. Nov 01 09:00:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3d5f3782-1f8b-463c-ae62-07cf9ec79eee tempest-VolumesActionsTest-709951013 None] Lock "cinder-8100801f-f256-424b-9104-d8d9fb0dd2a8-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Flow 'volume_create_manager' (addc7380-2cfb-4ffb-8f40-6dd8f6a347e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca3d192-c02f-44e2-9a33-0ea559b97d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca3d192-c02f-44e2-9a33-0ea559b97d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-333427508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d337b80-15d9-4c5a-acb7-4429745c4ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d63c5481224cc5b2252e3fd8543f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:32Z,use_quota=True,user_id='cb46834c66fb415c95d5519fab351f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b59d4a3-d6dc-4db9-8872-bec973ec26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b59d4a3-d6dc-4db9-8872-bec973ec26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41abb1ad-d481-4b5b-8527-ca6ef0786363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41abb1ad-d481-4b5b-8527-ca6ef0786363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d337b80-15d9-4c5a-acb7-4429745c4ca1', 'volume_name': 'volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cc7b13-a47e-4021-b32e-3b208e921210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cc7b13-a47e-4021-b32e-3b208e921210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e317b07-197f-438f-852a-36304a28f497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:32 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Volume 1d337b80-15d9-4c5a-acb7-4429745c4ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1', 'volume_size': 1} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-333427508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d337b80-15d9-4c5a-acb7-4429745c4ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d63c5481224cc5b2252e3fd8543f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:32Z,use_quota=True,user_id='cb46834c66fb415c95d5519fab351f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Creating volume 1d337b80-15d9-4c5a-acb7-4429745c4ca1 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:32 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:32 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 1073741824 Nov 01 09:00:32 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:33 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 1073741824" returned: 0 in 0.714s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:33 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 Nov 01 09:00:33 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:33 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1" returned: 0 in 0.396s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e317b07-197f-438f-852a-36304a28f497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e0bc71-30ad-4ad2-8a23-453df379bf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:33 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Volume volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 (1d337b80-15d9-4c5a-acb7-4429745c4ca1): created successfully Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e0bc71-30ad-4ad2-8a23-453df379bf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Flow 'volume_create_manager' (addc7380-2cfb-4ffb-8f40-6dd8f6a347e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:33 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f9bbb4a6-30c8-456e-a0c3-559fe526f051 tempest-AttachVolumeTestJSON-1502485002 None] Created volume successfully. Nov 01 09:00:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-f3a5bb7d-70f0-4a45-848f-1c412046e521 req-30850156-7160-42cb-8473-5e39ae868aee tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-f3a5bb7d-70f0-4a45-848f-1c412046e521 req-30850156-7160-42cb-8473-5e39ae868aee tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-f3a5bb7d-70f0-4a45-848f-1c412046e521 req-30850156-7160-42cb-8473-5e39ae868aee tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-f3a5bb7d-70f0-4a45-848f-1c412046e521 req-30850156-7160-42cb-8473-5e39ae868aee tempest-TestServerVolumeAttachmentScenario-1663430955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-f6bc5046-9a0e-422a-a8dd-232020f99220', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ed7e06-3f39-4212-929c-9eb031a7c98c', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:00:34 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-f3a5bb7d-70f0-4a45-848f-1c412046e521 req-30850156-7160-42cb-8473-5e39ae868aee tempest-TestServerVolumeAttachmentScenario-1663430955 None] attachment_update completed successfully. Nov 01 09:00:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-287477ee-46fc-4c7e-932f-942de2ccb039 req-5d294f2d-0e25-4fd6-b733-80272008c3a1 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-287477ee-46fc-4c7e-932f-942de2ccb039 req-5d294f2d-0e25-4fd6-b733-80272008c3a1 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-287477ee-46fc-4c7e-932f-942de2ccb039 req-5d294f2d-0e25-4fd6-b733-80272008c3a1 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-287477ee-46fc-4c7e-932f-942de2ccb039 req-5d294f2d-0e25-4fd6-b733-80272008c3a1 tempest-AttachVolumeTestJSON-1502485002 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2dde2e45-0cc8-481e-9388-1d1cff79cf7d', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:00:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-287477ee-46fc-4c7e-932f-942de2ccb039 req-5d294f2d-0e25-4fd6-b733-80272008c3a1 tempest-AttachVolumeTestJSON-1502485002 None] attachment_update completed successfully. Nov 01 09:00:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-2443412b-9207-4fdc-88da-406cc7cf859c req-34ec28e2-6cef-494d-8982-be4c7beb5369 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Terminate volume connection completed successfully. Nov 01 09:00:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2443412b-9207-4fdc-88da-406cc7cf859c req-34ec28e2-6cef-494d-8982-be4c7beb5369 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Deleting attachment 93ed7e06-3f39-4212-929c-9eb031a7c98c. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:00:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-6863fd33-cef6-4427-8419-bc33b249a5c4 req-28b12b64-4021-4bd9-a57b-821fe07ef568 tempest-AttachVolumeTestJSON-1502485002 None] Terminate volume connection completed successfully. Nov 01 09:00:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-6863fd33-cef6-4427-8419-bc33b249a5c4 req-28b12b64-4021-4bd9-a57b-821fe07ef568 tempest-AttachVolumeTestJSON-1502485002 None] Deleting attachment a88a208d-1394-4f62-a648-dad2236c1783. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:00:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-49ece255-dead-43c9-a299-886023df833a req-79fa7129-0d1a-4158-b014-bc758807218c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Terminate volume connection completed successfully. Nov 01 09:00:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-49ece255-dead-43c9-a299-886023df833a req-79fa7129-0d1a-4158-b014-bc758807218c tempest-TestServerVolumeAttachmentScenario-1663430955 None] Deleting attachment 81af3a8c-e582-4d67-bd2a-b2dc7652d0b0. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:00:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-b14462db-64ba-4ff2-848d-06b1b28d296d req-d5f64a44-f54a-444a-b2a7-e173e641fbde tempest-AttachVolumeTestJSON-1502485002 None] Terminate volume connection completed successfully. Nov 01 09:00:39 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-b14462db-64ba-4ff2-848d-06b1b28d296d req-d5f64a44-f54a-444a-b2a7-e173e641fbde tempest-AttachVolumeTestJSON-1502485002 None] Deleting attachment 2dde2e45-0cc8-481e-9388-1d1cff79cf7d. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:00:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "cinder-f6bc5046-9a0e-422a-a8dd-232020f99220-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-f6bc5046-9a0e-422a-a8dd-232020f99220-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "cinder-quobyte-f6bc5046-9a0e-422a-a8dd-232020f99220" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-quobyte-f6bc5046-9a0e-422a-a8dd-232020f99220" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe414ee-89f6-42b2-a3c4-8e91c469a40e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:44 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 Nov 01 09:00:44 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:45 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220" returned: 0 in 0.469s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:45 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220 Nov 01 09:00:45 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:45 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f6bc5046-9a0e-422a-a8dd-232020f99220" returned: 0 in 0.310s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-quobyte-f6bc5046-9a0e-422a-a8dd-232020f99220" released by "delete_volume" :: held 0.838s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Created reservations ['a78b2aee-d1c7-4bb8-9a7e-b8467f38a7f3', 'd8bfa2f2-edc8-40c4-92b8-dc42f9cf3e83', 'eeba8371-01f8-47ce-b625-0280b68e7709', '1c7704ad-b848-48d9-8320-c8f734b55ada'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:45 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:45 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "cinder-c6c76190-ec44-4652-92db-e53cf25c2360-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-c6c76190-ec44-4652-92db-e53cf25c2360-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "cinder-quobyte-c6c76190-ec44-4652-92db-e53cf25c2360" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-quobyte-c6c76190-ec44-4652-92db-e53cf25c2360" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "cinder-1d337b80-15d9-4c5a-acb7-4429745c4ca1-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4836d0e5-a83d-4bb9-8ffb-5844b25596ca]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-1d337b80-15d9-4c5a-acb7-4429745c4ca1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "cinder-quobyte-1d337b80-15d9-4c5a-acb7-4429745c4ca1" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-quobyte-1d337b80-15d9-4c5a-acb7-4429745c4ca1" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f85a5-866b-43de-b3bb-94afc4f81cdc]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:46 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.468s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Deleted volume successfully. Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-031333c6-24f3-4812-9855-0c7b2384a332 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-f6bc5046-9a0e-422a-a8dd-232020f99220-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:46 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 Nov 01 09:00:46 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:46 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 Nov 01 09:00:46 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:46 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360" returned: 0 in 0.506s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:46 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360 Nov 01 09:00:46 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:46 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1" returned: 0 in 0.431s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:46 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1 Nov 01 09:00:46 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:46 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c6c76190-ec44-4652-92db-e53cf25c2360" returned: 0 in 0.277s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-quobyte-c6c76190-ec44-4652-92db-e53cf25c2360" released by "delete_volume" :: held 0.861s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:46 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1d337b80-15d9-4c5a-acb7-4429745c4ca1" returned: 0 in 0.295s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-quobyte-1d337b80-15d9-4c5a-acb7-4429745c4ca1" released by "delete_volume" :: held 0.789s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Created reservations ['05ddc334-77a1-4af2-9864-c12ac4110874', 'e0439574-abd7-46b1-93ac-86877a97f744', '7813c7c9-df4e-4dbb-a319-1c1406e511f7', '92b70a01-90f2-4d3c-b365-36d860d1043b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:46 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Created reservations ['50251206-a02f-4737-939f-aac5bac92778', '7a279ced-9c4e-49b6-bd88-8c2137efba7d', 'b3089743-5435-4b17-ad21-083ea83ba2dd', 'f9498eed-f746-4d8e-a3af-ebc5df39a053'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:47 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:47 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:47 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:47 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "cinder-42b17187-6f85-443b-aab7-be0c56e71767-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-42b17187-6f85-443b-aab7-be0c56e71767-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "cinder-quobyte-42b17187-6f85-443b-aab7-be0c56e71767" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:47 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-quobyte-42b17187-6f85-443b-aab7-be0c56e71767" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:47 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.375s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.443s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Deleted volume successfully. Nov 01 09:00:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Deleted volume successfully. Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea822e-d072-4110-83a1-e1d6648b4705]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-508cab75-0dd4-43fb-8415-fa175d4f1b17 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-1d337b80-15d9-4c5a-acb7-4429745c4ca1-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-247f7d28-2cdf-4db0-b99c-a66c6cf7d705 tempest-TestServerVolumeAttachmentScenario-1663430955 None] Lock "cinder-c6c76190-ec44-4652-92db-e53cf25c2360-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:47 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 Nov 01 09:00:47 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:47 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767" returned: 0 in 0.433s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:47 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767 Nov 01 09:00:47 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:48 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-42b17187-6f85-443b-aab7-be0c56e71767" returned: 0 in 0.297s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-quobyte-42b17187-6f85-443b-aab7-be0c56e71767" released by "delete_volume" :: held 0.804s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Created reservations ['b647e8b5-114a-4c71-b298-5d8ba114fea2', '30725f56-3e6e-428b-afb6-ea9d66b2a938', '461c59f1-1972-4c1c-9303-21ca1e23f563', '6ca93d95-37bf-4ba5-b00c-2a1fb53ea0b7'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:48 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:48 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "cinder-cd7d4fc7-b909-4fac-ace2-eafb52894c92-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-cd7d4fc7-b909-4fac-ace2-eafb52894c92-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:48 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.428s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "cinder-quobyte-cd7d4fc7-b909-4fac-ace2-eafb52894c92" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:48 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Deleted volume successfully. Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-quobyte-cd7d4fc7-b909-4fac-ace2-eafb52894c92" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4feeae0c-373c-4897-8aa2-4547534acc1e tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-42b17187-6f85-443b-aab7-be0c56e71767-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab67d72d-4175-4fd3-a0a1-ffe5a91c7f11]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:49 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 Nov 01 09:00:49 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:49 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92" returned: 0 in 0.434s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:49 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92 Nov 01 09:00:49 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:49 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cd7d4fc7-b909-4fac-ace2-eafb52894c92" returned: 0 in 0.346s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-quobyte-cd7d4fc7-b909-4fac-ace2-eafb52894c92" released by "delete_volume" :: held 0.843s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Created reservations ['42b48c38-54d0-469c-93f5-1b9f1e52a8d4', 'b8c533a9-c8b0-4645-ab16-6c363833e5b7', '6a320981-f0fd-47ae-9f77-9f4695d21bc2', 'f1215f32-db73-4215-824d-3f63c533f899'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:49 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:49 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:50 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.298s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:50 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Deleted volume successfully. Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c13c2f4d-988c-49e3-a16c-f4c2136a2199 tempest-AttachVolumeTestJSON-1502485002 None] Lock "cinder-cd7d4fc7-b909-4fac-ace2-eafb52894c92-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Flow 'volume_create_manager' (180222ef-fbba-415e-a9de-232942ef7f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1330f7-68c8-4a6b-9198-fb886b40b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1330f7-68c8-4a6b-9198-fb886b40b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1408143595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca86b57-e6a1-4f46-8d9f-df2363fbce14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd31f39cbc5d49329143305fbb52d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:51Z,use_quota=True,user_id='33c846424d2c4c099a95d7201d44e39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e2dd1a-5ff0-4be9-9d96-1f1139ed0e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e2dd1a-5ff0-4be9-9d96-1f1139ed0e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1ada47-7a0e-4acc-a271-db37eb59a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1ada47-7a0e-4acc-a271-db37eb59a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca86b57-e6a1-4f46-8d9f-df2363fbce14', 'volume_name': 'volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747abea0-67ef-4fc8-b66d-bdbb13d8351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747abea0-67ef-4fc8-b66d-bdbb13d8351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c93196-57d5-4d71-b5be-05b851b00000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Volume 9ca86b57-e6a1-4f46-8d9f-df2363fbce14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14', 'volume_size': 1} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1408143595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca86b57-e6a1-4f46-8d9f-df2363fbce14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd31f39cbc5d49329143305fbb52d816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:00:51Z,use_quota=True,user_id='33c846424d2c4c099a95d7201d44e39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Creating volume 9ca86b57-e6a1-4f46-8d9f-df2363fbce14 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:00:50 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:00:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:50 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 1073741824 Nov 01 09:00:50 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:51 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 1073741824" returned: 0 in 0.630s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:51 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 Nov 01 09:00:51 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:51 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14" returned: 0 in 0.346s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:00:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c93196-57d5-4d71-b5be-05b851b00000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02247af-da3d-4bc1-9835-7def4603ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:00:52 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Volume volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 (9ca86b57-e6a1-4f46-8d9f-df2363fbce14): created successfully Nov 01 09:00:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02247af-da3d-4bc1-9835-7def4603ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:00:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Flow 'volume_create_manager' (180222ef-fbba-415e-a9de-232942ef7f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:00:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9b3e9f8a-e788-4520-84fb-d57c975fc543 tempest-VolumesMetadataTest-707746890 None] Created volume successfully. Nov 01 09:00:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Acquiring lock "cinder-9ca86b57-e6a1-4f46-8d9f-df2363fbce14-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Lock "cinder-9ca86b57-e6a1-4f46-8d9f-df2363fbce14-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Acquiring lock "cinder-quobyte-9ca86b57-e6a1-4f46-8d9f-df2363fbce14" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Lock "cinder-quobyte-9ca86b57-e6a1-4f46-8d9f-df2363fbce14" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7b33cd-9811-429c-9801-c1cdf4483ec0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:54 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 Nov 01 09:00:54 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:54 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14" returned: 0 in 0.523s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:54 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14 Nov 01 09:00:54 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:54 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9ca86b57-e6a1-4f46-8d9f-df2363fbce14" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Lock "cinder-quobyte-9ca86b57-e6a1-4f46-8d9f-df2363fbce14" released by "delete_volume" :: held 0.858s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:00:54 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Created reservations ['31ac0949-405f-4da3-9911-18a4e3ecbf3d', '8c5859ee-9e7f-4d63-b4d1-4f417e3c1675', 'fa8ad4e1-c7f8-4f52-b16e-e36147596dc5', '4d82976e-2acd-4667-b03b-d9f2b98be13a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:00:55 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:00:55 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:00:55 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.418s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:00:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Deleted volume successfully. Nov 01 09:00:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8b5074ec-1524-4352-999c-d76b1f257b71 tempest-VolumesMetadataTest-707746890 None] Lock "cinder-9ca86b57-e6a1-4f46-8d9f-df2363fbce14-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Flow 'volume_create_manager' (a8eecd8a-36de-440c-b543-2639a75e4cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202804d3-293b-4466-aa0f-04441aa9cb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202804d3-293b-4466-aa0f-04441aa9cb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-741951963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b2b93b-600d-4fea-94eb-794af99decb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a38d0b8bb964ce5be876864794042eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:01Z,use_quota=True,user_id='7eeb383ed7134ccd9de6e0ff8218239d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdd7428-1abc-4a2a-bae6-6b3c9c41f491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdd7428-1abc-4a2a-bae6-6b3c9c41f491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c234d6d7-f1df-4a2c-906e-9ac44f2ed26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c234d6d7-f1df-4a2c-906e-9ac44f2ed26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b2b93b-600d-4fea-94eb-794af99decb4', 'volume_name': 'volume-01b2b93b-600d-4fea-94eb-794af99decb4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca27bbbf-e668-4f94-80a6-419e56c61685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca27bbbf-e668-4f94-80a6-419e56c61685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1644b12-0f7c-47b2-b337-eba077020ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:01 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Volume 01b2b93b-600d-4fea-94eb-794af99decb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b2b93b-600d-4fea-94eb-794af99decb4', 'volume_size': 1} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-741951963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b2b93b-600d-4fea-94eb-794af99decb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a38d0b8bb964ce5be876864794042eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:01Z,use_quota=True,user_id='7eeb383ed7134ccd9de6e0ff8218239d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Creating volume 01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:01 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:01 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-c86d9f20-4407-48fd-b3f4-9377edc351cb tempest-TestShelveInstance-454297867 None] Terminate volume connection completed successfully. Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-c86d9f20-4407-48fd-b3f4-9377edc351cb tempest-TestShelveInstance-454297867 None] Deleting attachment 991b70f1-5a05-4359-9604-c68d5357a953. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:01:01 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 1073741824 Nov 01 09:01:01 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Acquiring lock "cinder-53eb44c6-4172-4226-9108-2ab7f9316e0d-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Lock "cinder-53eb44c6-4172-4226-9108-2ab7f9316e0d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Acquiring lock "cinder-quobyte-53eb44c6-4172-4226-9108-2ab7f9316e0d" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Lock "cinder-quobyte-53eb44c6-4172-4226-9108-2ab7f9316e0d" acquired by "delete_volume" :: waited 0.044s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abe46d8-b056-4b08-b318-0be759977d57]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:01 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d Nov 01 09:01:01 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:01 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 1073741824" returned: 0 in 0.792s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:02 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 Nov 01 09:01:02 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:02 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d" returned: 0 in 0.649s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:02 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d Nov 01 09:01:02 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:02 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4" returned: 0 in 0.413s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1644b12-0f7c-47b2-b337-eba077020ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b2b93b-600d-4fea-94eb-794af99decb4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52ab145-6fa2-444b-85ff-126f706760d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:02 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Volume volume-01b2b93b-600d-4fea-94eb-794af99decb4 (01b2b93b-600d-4fea-94eb-794af99decb4): created successfully Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52ab145-6fa2-444b-85ff-126f706760d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Flow 'volume_create_manager' (a8eecd8a-36de-440c-b543-2639a75e4cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-238ac760-9feb-411e-a9b4-8d772760fa9b tempest-VolumesCloneTest-908069195 None] Created volume successfully. Nov 01 09:01:02 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-53eb44c6-4172-4226-9108-2ab7f9316e0d" returned: 0 in 0.399s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Lock "cinder-quobyte-53eb44c6-4172-4226-9108-2ab7f9316e0d" released by "delete_volume" :: held 1.121s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.quota [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Created reservations ['6764f6c9-73e1-421a-90c2-59cd4aa282a0', '5c66654b-07d9-46ba-ae94-ffd0aa2890f5', 'd01eddad-ab96-4e1b-9433-b85384730717', '1d926fa3-3fb8-4deb-8767-43a72f68dc9a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:03 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:03 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:03 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.277s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:03 devstack cinder-volume[86770]: DEBUG cinder.manager [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Deleted volume successfully. Nov 01 09:01:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [req-e8ef8575-b346-41a3-ba54-920372e54c18 req-8304afe9-8037-481c-bdad-5eee966aec87 tempest-TestShelveInstance-454297867 None] Lock "cinder-53eb44c6-4172-4226-9108-2ab7f9316e0d-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Flow 'volume_create_manager' (e0f9de0c-99eb-4530-a1e9-1ed0a37166e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa98982-2a53-4e91-a84d-2c82a2164a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa98982-2a53-4e91-a84d-2c82a2164a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-932788435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcbd28b-838b-442a-9a46-79b397782929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a38d0b8bb964ce5be876864794042eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=01b2b93b-600d-4fea-94eb-794af99decb4,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:04Z,use_quota=True,user_id='7eeb383ed7134ccd9de6e0ff8218239d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0f5d9f-d711-43e3-8f5e-eb1a34e477e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0f5d9f-d711-43e3-8f5e-eb1a34e477e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ecf141-a08a-4025-b1c1-bf0fbe378f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ecf141-a08a-4025-b1c1-bf0fbe378f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'adcbd28b-838b-442a-9a46-79b397782929', 'volume_name': 'volume-adcbd28b-838b-442a-9a46-79b397782929', 'volume_size': 2, 'source_volid': '01b2b93b-600d-4fea-94eb-794af99decb4', 'source_volstatus': 'available'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018a3739-eeae-43f5-9d53-97d94557c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018a3739-eeae-43f5-9d53-97d94557c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b24b575-1e09-44eb-aa8e-fb02eedc01e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:04 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Volume adcbd28b-838b-442a-9a46-79b397782929: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-adcbd28b-838b-442a-9a46-79b397782929', 'volume_size': 2, 'source_volid': '01b2b93b-600d-4fea-94eb-794af99decb4', 'source_volstatus': 'available'} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:04 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Cloning volume 01b2b93b-600d-4fea-94eb-794af99decb4 to volume adcbd28b-838b-442a-9a46-79b397782929 Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Creating offline snapshot 025d84c9-48d6-416c-8767-b2649481cc23 of volume 01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1f12f4-7aba-4b91-ad03-3bf293fde906]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:04 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 Nov 01 09:01:04 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:04 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4" returned: 0 in 0.535s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:04 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 1G Nov 01 09:01:04 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:05 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (8ea21010-c37a-4fe6-8c30-d0aab5f653e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fde62c-30b2-4df7-b548-02f6ef8548d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 1G" returned: 0 in 0.616s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b2b93b-600d-4fea-94eb-794af99decb4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fde62c-30b2-4df7-b548-02f6ef8548d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668955431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9705e647-85d1-495c-b4e6-d55a00f03fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:05Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6657d-5795-4aa5-a2f7-875ca9a7a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:05 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b2b93b-600d-4fea-94eb-794af99decb4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6657d-5795-4aa5-a2f7-875ca9a7a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:05 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3115f8c3-ab3f-4625-ba5d-d6c21178a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3115f8c3-ab3f-4625-ba5d-d6c21178a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9705e647-85d1-495c-b4e6-d55a00f03fc2', 'volume_name': 'volume-9705e647-85d1-495c-b4e6-d55a00f03fc2', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7b3ad7-3a5d-4299-840f-f950c4dfd978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7b3ad7-3a5d-4299-840f-f950c4dfd978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338e7180-6303-489b-b679-d76f036adb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume 9705e647-85d1-495c-b4e6-d55a00f03fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9705e647-85d1-495c-b4e6-d55a00f03fc2', 'volume_size': 1} Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:05 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01b2b93b-600d-4fea-94eb-794af99decb4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23" returned: 0 in 0.372s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:05 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 is being set with open permissions: ugo+rw Nov 01 09:01:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:05 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 Nov 01 09:01:05 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:06 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:06 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.info Nov 01 09:01:06 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:06 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.info" returned: 0 in 0.365s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:06 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.info is being set with open permissions: ugo+rw Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:06 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.info Nov 01 09:01:06 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:06 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.info" returned: 0 in 0.282s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Acquiring lock "cinder-quobyte-adcbd28b-838b-442a-9a46-79b397782929" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-adcbd28b-838b-442a-9a46-79b397782929" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] snapshot: 025d84c9-48d6-416c-8767-b2649481cc23, volume: adcbd28b-838b-442a-9a46-79b397782929, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cde64ef-2b25-4ade-b312-7d674311a5b4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:07 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 Nov 01 09:01:07 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:07 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23" returned: 0 in 0.486s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b2b93b-600d-4fea-94eb-794af99decb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[094f94ad-d818-4912-a2cd-f6dae057936d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:07 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 Nov 01 09:01:07 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:07 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4" returned: 0 in 0.476s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:01:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:07 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 Nov 01 09:01:07 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:16 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=67,cinder:UPDATE=70,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:01:16 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=76,cinder:UPDATE=86,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:01:16 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929" returned: 0 in 8.931s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:16 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:01:16 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Converted 1024.00 MB image at 114.64 MB/s Nov 01 09:01:16 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 is being set with open permissions: ugo+rw Nov 01 09:01:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:16 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 Nov 01 09:01:16 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:17 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-adcbd28b-838b-442a-9a46-79b397782929" released by "_copy_volume_from_snapshot" :: held 10.261s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Acquiring lock "cinder-quobyte-025d84c9-48d6-416c-8767-b2649481cc23" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-025d84c9-48d6-416c-8767-b2649481cc23" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Deleting offline snapshot 025d84c9-48d6-416c-8767-b2649481cc23 of volume 01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] snapshot_file for this snap is: volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe308d4-b994-4902-aaac-da549609af02]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:17 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 Nov 01 09:01:17 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:17 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23" returned: 0 in 0.449s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01b2b93b-600d-4fea-94eb-794af99decb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2427c77b-0bf4-4420-a159-74f0673c2f63]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:17 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 Nov 01 09:01:17 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:18 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4" returned: 0 in 0.583s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:18 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 Nov 01 09:01:18 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:18 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:18 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23 Nov 01 09:01:18 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:18 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4.025d84c9-48d6-416c-8767-b2649481cc23" returned: 0 in 0.266s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-025d84c9-48d6-416c-8767-b2649481cc23" released by "_delete_snapshot" :: held 1.857s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.801s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.502s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668955431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9705e647-85d1-495c-b4e6-d55a00f03fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:05Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Creating volume 9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:19 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b24b575-1e09-44eb-aa8e-fb02eedc01e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adcbd28b-838b-442a-9a46-79b397782929', 'volume_size': 2, 'source_volid': '01b2b93b-600d-4fea-94eb-794af99decb4', 'source_volstatus': 'available'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:19 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 1073741824 Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c047c5-6fe7-400e-8d58-c18aa39920fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:19 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:19 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Volume volume-adcbd28b-838b-442a-9a46-79b397782929 (adcbd28b-838b-442a-9a46-79b397782929): created successfully Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c047c5-6fe7-400e-8d58-c18aa39920fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Flow 'volume_create_manager' (e0f9de0c-99eb-4530-a1e9-1ed0a37166e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1f583155-86ad-466c-ae62-eec308c5baa0 tempest-VolumesCloneTest-908069195 None] Created volume successfully. Nov 01 09:01:19 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 1073741824" returned: 0 in 0.544s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:19 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 Nov 01 09:01:19 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Acquiring lock "cinder-adcbd28b-838b-442a-9a46-79b397782929-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:20 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Lock "cinder-adcbd28b-838b-442a-9a46-79b397782929-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2" returned: 0 in 0.408s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338e7180-6303-489b-b679-d76f036adb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9705e647-85d1-495c-b4e6-d55a00f03fc2', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c3f4d7-b0b0-4182-a87e-4a8b105cf376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Acquiring lock "cinder-quobyte-adcbd28b-838b-442a-9a46-79b397782929" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:20 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 (9705e647-85d1-495c-b4e6-d55a00f03fc2): created successfully Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c3f4d7-b0b0-4182-a87e-4a8b105cf376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (8ea21010-c37a-4fe6-8c30-d0aab5f653e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-adcbd28b-838b-442a-9a46-79b397782929" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-bd9d5bfe-ae4e-4d36-922f-458c9669a7c6 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created volume successfully. Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51f96e7-a452-425d-90e5-deebc77848bb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:20 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 Nov 01 09:01:20 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:20 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929" returned: 0 in 0.513s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:20 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929 Nov 01 09:01:20 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:21 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-adcbd28b-838b-442a-9a46-79b397782929" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-adcbd28b-838b-442a-9a46-79b397782929" released by "delete_volume" :: held 0.979s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Created reservations ['59261d82-3200-4459-a865-1301a26b3215', 'f3b28d6f-ad51-4eef-be73-4af98c7f0b63', 'e6d7105d-ee93-4090-98c6-12776fcc9878', '33ab4682-e7a3-4ef6-92b3-bb1eb958ca5b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:21 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:21 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:21 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:21 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Creating offline snapshot 02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 of volume 9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319fb89-5c0d-4dae-9c0b-07db5b47b99d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:21 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.537s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:01:21 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 Nov 01 09:01:21 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:21 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.587s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:21 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Deleted volume successfully. Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16e48887-d2a3-433b-b21b-17a685a17d7f tempest-VolumesCloneTest-908069195 None] Lock "cinder-adcbd28b-838b-442a-9a46-79b397782929-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:22 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2" returned: 0 in 0.468s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:22 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 1G Nov 01 09:01:22 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Acquiring lock "cinder-01b2b93b-600d-4fea-94eb-794af99decb4-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Lock "cinder-01b2b93b-600d-4fea-94eb-794af99decb4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Acquiring lock "cinder-quobyte-01b2b93b-600d-4fea-94eb-794af99decb4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-01b2b93b-600d-4fea-94eb-794af99decb4" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf7cc78-0d89-4385-8f09-287c6f041e17]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:22 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 1G" returned: 0 in 0.653s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:22 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 Nov 01 09:01:22 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:22 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 Nov 01 09:01:22 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:23 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" returned: 0 in 0.419s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:23 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 is being set with open permissions: ugo+rw Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:23 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4" returned: 0 in 0.512s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:23 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 Nov 01 09:01:23 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:23 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4 Nov 01 09:01:23 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:23 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" returned: 0 in 0.331s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:23 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-01b2b93b-600d-4fea-94eb-794af99decb4" returned: 0 in 0.349s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Lock "cinder-quobyte-01b2b93b-600d-4fea-94eb-794af99decb4" released by "delete_volume" :: held 0.966s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:23 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.info Nov 01 09:01:23 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Created reservations ['855d5f6c-6e86-4767-bb98-495d3c0e60ed', '5b8e43d8-f795-401c-8319-581fdfdfe150', '72a4b448-4870-4091-b164-654a79e87f55', '703d7a47-0ad4-4b30-a5d6-68cff17b0b30'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:23 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:23 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:24 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.info" returned: 0 in 0.420s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:24 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.info is being set with open permissions: ugo+rw Nov 01 09:01:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:24 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.info Nov 01 09:01:24 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:24 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.322s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:24 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Deleted volume successfully. Nov 01 09:01:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1b0e88b-f422-43d9-834f-b43acad17436 tempest-VolumesCloneTest-908069195 None] Lock "cinder-01b2b93b-600d-4fea-94eb-794af99decb4-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:24 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.info" returned: 0 in 0.366s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.861s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e56a3ff2-778c-4cb3-8247-d4837ae92bca tempest-CreateVolumesFromSnapshotTest-1487674779 None] Create snapshot completed successfully Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (654c2e58-015b-46fa-93a4-7571ab040570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca85f15-b97f-4c3f-99f8-e9ec550d8c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca85f15-b97f-4c3f-99f8-e9ec550d8c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-53889719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db22af3-6b6f-4809-a82f-1a29f0700784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:25Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6385bcf-d8c2-4a7b-963a-be7b4364f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6385bcf-d8c2-4a7b-963a-be7b4364f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a791aa5-8309-4d29-8e0d-994276d7d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a791aa5-8309-4d29-8e0d-994276d7d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db22af3-6b6f-4809-a82f-1a29f0700784', 'volume_name': 'volume-2db22af3-6b6f-4809-a82f-1a29f0700784', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ba16f-9435-4c81-855e-94852bba3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ba16f-9435-4c81-855e-94852bba3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c044d85-9e31-4e42-b096-30ed16c9b29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume 2db22af3-6b6f-4809-a82f-1a29f0700784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db22af3-6b6f-4809-a82f-1a29f0700784', 'volume_size': 1} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-53889719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db22af3-6b6f-4809-a82f-1a29f0700784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:25Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Creating volume 2db22af3-6b6f-4809-a82f-1a29f0700784 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:25 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:25 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 1073741824 Nov 01 09:01:25 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (e0d0bb6a-7599-4646-9d07-232a1b445220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384ca3a2-14ed-4f70-a7bc-bc2af68d0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384ca3a2-14ed-4f70-a7bc-bc2af68d0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735281954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981a8616-b3db-4819-8d2c-2cfb70f60e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:26Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63d5d7e-8e82-45bc-9fe9-15cc63bacd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63d5d7e-8e82-45bc-9fe9-15cc63bacd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64191522-adc4-444c-937c-cf22de22c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64191522-adc4-444c-937c-cf22de22c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981a8616-b3db-4819-8d2c-2cfb70f60e66', 'volume_name': 'volume-981a8616-b3db-4819-8d2c-2cfb70f60e66', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4858c8cb-c6e3-46ad-9e82-3277948e967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4858c8cb-c6e3-46ad-9e82-3277948e967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314aa177-804a-4c2a-9878-98a0783dbeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume 981a8616-b3db-4819-8d2c-2cfb70f60e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981a8616-b3db-4819-8d2c-2cfb70f60e66', 'volume_size': 1} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:26 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 1073741824" returned: 0 in 1.259s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:26 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (671a648e-69f5-4181-a508-87f1bb17ddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0311653-0ce7-4a58-9303-5a4875d4f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0311653-0ce7-4a58-9303-5a4875d4f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861479341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ec1cd8-98d5-488f-8570-b053eac85cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:27Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb27f71-91a8-439c-bbbe-77c42908ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb27f71-91a8-439c-bbbe-77c42908ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc542709-800f-4633-a1ba-f0ebceb601c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc542709-800f-4633-a1ba-f0ebceb601c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ec1cd8-98d5-488f-8570-b053eac85cf7', 'volume_name': 'volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17814163-8b9b-4236-88c7-d2fda3349481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17814163-8b9b-4236-88c7-d2fda3349481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9aa8cfa-3572-4f0f-827e-b58d6cd12349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume b4ec1cd8-98d5-488f-8570-b053eac85cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7', 'volume_size': 1} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:27 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 Nov 01 09:01:27 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:27 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (9788db6a-8d1b-4fe0-956f-c60a7f5edf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25b1543-9b5c-4c1e-9507-03bda12ab3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784" returned: 0 in 0.695s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.289s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735281954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981a8616-b3db-4819-8d2c-2cfb70f60e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:26Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Creating volume 981a8616-b3db-4819-8d2c-2cfb70f60e66 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:27 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25b1543-9b5c-4c1e-9507-03bda12ab3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1310815339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502956ee-249b-4f45-9bc6-32c6cf8c530b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:28Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:27 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 1073741824 Nov 01 09:01:27 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89c4602-1078-436f-a6bf-74eb6b0d8c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89c4602-1078-436f-a6bf-74eb6b0d8c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338d2252-98a0-4ddd-a19b-da6c7f0e618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338d2252-98a0-4ddd-a19b-da6c7f0e618c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502956ee-249b-4f45-9bc6-32c6cf8c530b', 'volume_name': 'volume-502956ee-249b-4f45-9bc6-32c6cf8c530b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc513c75-bf42-4b7e-926c-79f3b6c767d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc513c75-bf42-4b7e-926c-79f3b6c767d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7de3aa-d4c1-4d51-8487-970aa6ed2426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume 502956ee-249b-4f45-9bc6-32c6cf8c530b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502956ee-249b-4f45-9bc6-32c6cf8c530b', 'volume_size': 1} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c044d85-9e31-4e42-b096-30ed16c9b29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db22af3-6b6f-4809-a82f-1a29f0700784', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88babdad-da4d-4f8c-b79d-1341ac163847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume volume-2db22af3-6b6f-4809-a82f-1a29f0700784 (2db22af3-6b6f-4809-a82f-1a29f0700784): created successfully Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88babdad-da4d-4f8c-b79d-1341ac163847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (654c2e58-015b-46fa-93a4-7571ab040570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1626fdb3-3cee-4c6b-a225-cbad80198623 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created volume successfully. Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (36ef19ef-7baa-4b48-bbae-47cd77ab9ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c41dcc-0e3d-4d7d-9bd3-1b1a5706dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c41dcc-0e3d-4d7d-9bd3-1b1a5706dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511492393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:29Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc0db03-e953-4890-94ff-8c2500c1b68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc0db03-e953-4890-94ff-8c2500c1b68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d561bc-971f-40bd-a39a-b7a9cb5248f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d561bc-971f-40bd-a39a-b7a9cb5248f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0', 'volume_name': 'volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b617a44-c675-461d-8f64-2af9b8cdd1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b617a44-c675-461d-8f64-2af9b8cdd1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e31a6c0-ff61-4cad-996c-267a5f989416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:29 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume 26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0', 'volume_size': 1} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:29 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 1073741824" returned: 0 in 1.382s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:29 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 Nov 01 09:01:29 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:29 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66" returned: 0 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.588s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861479341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ec1cd8-98d5-488f-8570-b053eac85cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:27Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Creating volume b4ec1cd8-98d5-488f-8570-b053eac85cf7 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:29 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314aa177-804a-4c2a-9878-98a0783dbeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981a8616-b3db-4819-8d2c-2cfb70f60e66', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abf0f19-fc84-4db9-8b03-c40befde2743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:29 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 1073741824 Nov 01 09:01:29 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:29 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 (981a8616-b3db-4819-8d2c-2cfb70f60e66): created successfully Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abf0f19-fc84-4db9-8b03-c40befde2743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (e0d0bb6a-7599-4646-9d07-232a1b445220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:29 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cef27dd6-eaea-4030-86ff-af65b50643a4 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created volume successfully. Nov 01 09:01:30 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 1073741824" returned: 0 in 0.848s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:30 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 Nov 01 09:01:30 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:31 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7" returned: 0 in 0.517s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.100s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1310815339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502956ee-249b-4f45-9bc6-32c6cf8c530b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:28Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Creating volume 502956ee-249b-4f45-9bc6-32c6cf8c530b {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:31 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9aa8cfa-3572-4f0f-827e-b58d6cd12349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5a378c-2266-4a99-98d6-8ade89d2ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:31 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b 1073741824 Nov 01 09:01:31 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 (b4ec1cd8-98d5-488f-8570-b053eac85cf7): created successfully Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5a378c-2266-4a99-98d6-8ade89d2ef63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (671a648e-69f5-4181-a508-87f1bb17ddc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b24a2a57-ec6d-4d71-b8d3-cf5cc4e63a43 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created volume successfully. Nov 01 09:01:32 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b 1073741824" returned: 0 in 0.867s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:32 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b Nov 01 09:01:32 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:32 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b" returned: 0 in 0.583s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511492393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa44144afda04c0c887cf843a028dd4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:29Z,use_quota=True,user_id='7dbfdaa7e3864d1381ee5aa4d7f0aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Creating volume 26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:32 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7de3aa-d4c1-4d51-8487-970aa6ed2426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502956ee-249b-4f45-9bc6-32c6cf8c530b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:32 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 1073741824 Nov 01 09:01:32 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4dc505-4809-4b11-b167-7de46a71a5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:32 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume volume-502956ee-249b-4f45-9bc6-32c6cf8c530b (502956ee-249b-4f45-9bc6-32c6cf8c530b): created successfully Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4dc505-4809-4b11-b167-7de46a71a5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (9788db6a-8d1b-4fe0-956f-c60a7f5edf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d80a268f-bcb9-4ed0-a720-91bd99ff6e74 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created volume successfully. Nov 01 09:01:33 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 1073741824" returned: 0 in 0.824s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:33 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 Nov 01 09:01:33 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Flow 'volume_create_manager' (7fc26080-12c2-4aff-b6d9-29aa30a2c982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f6c46c-2814-42f3-bc00-a255b1965625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:34 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f6c46c-2814-42f3-bc00-a255b1965625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-841094238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d484ad77-d294-45ef-a507-88e9404a23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05320acfa831440ab3dd5a9cc7a402ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:34Z,use_quota=True,user_id='ae869b4bd7de4358b53444c46ec1a20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d315b130-096b-4f9f-8604-1f007150275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d315b130-096b-4f9f-8604-1f007150275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb4d7f9-fbbd-4277-9535-fa26b36bc9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb4d7f9-fbbd-4277-9535-fa26b36bc9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd484ad77-d294-45ef-a507-88e9404a23a7', 'volume_name': 'volume-d484ad77-d294-45ef-a507-88e9404a23a7', 'volume_size': 2}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6aee7a-6ba3-4b2f-a280-80acee8e4f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6aee7a-6ba3-4b2f-a280-80acee8e4f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699366bc-edc6-40f3-a96f-c0ad6d6f771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:34 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Volume d484ad77-d294-45ef-a507-88e9404a23a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d484ad77-d294-45ef-a507-88e9404a23a7', 'volume_size': 2} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0" returned: 0 in 0.477s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-841094238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d484ad77-d294-45ef-a507-88e9404a23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05320acfa831440ab3dd5a9cc7a402ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:34Z,use_quota=True,user_id='ae869b4bd7de4358b53444c46ec1a20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Creating volume d484ad77-d294-45ef-a507-88e9404a23a7 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:34 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 2147483648 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:34 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 2147483648 Nov 01 09:01:34 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e31a6c0-ff61-4cad-996c-267a5f989416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb4013d-2f6a-4992-b699-1627f2fd6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:34 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Volume volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 (26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0): created successfully Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb4013d-2f6a-4992-b699-1627f2fd6c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Flow 'volume_create_manager' (36ef19ef-7baa-4b48-bbae-47cd77ab9ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:34 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5eb2a076-68e3-4012-ab06-5429659d6069 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created volume successfully. Nov 01 09:01:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:35 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 2147483648" returned: 0 in 0.804s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:35 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 Nov 01 09:01:35 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[27146c51-67b9-45aa-86dc-9e24c4b09a01]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:35 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 Nov 01 09:01:35 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:35 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7" returned: 0 in 0.393s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699366bc-edc6-40f3-a96f-c0ad6d6f771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d484ad77-d294-45ef-a507-88e9404a23a7', 'volume_size': 2}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113c9a49-e2d3-4c4a-8fcb-cbf250c76f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Volume volume-d484ad77-d294-45ef-a507-88e9404a23a7 (d484ad77-d294-45ef-a507-88e9404a23a7): created successfully Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113c9a49-e2d3-4c4a-8fcb-cbf250c76f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Flow 'volume_create_manager' (7fc26080-12c2-4aff-b6d9-29aa30a2c982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:35 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0" returned: 0 in 0.390s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6800aca4-b490-4206-a8b9-ce9b3f7227c9 tempest-VolumesCloneNegativeTest-2074578671 None] Created volume successfully. Nov 01 09:01:35 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0 Nov 01 09:01:35 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:36 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0" returned: 0 in 0.642s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0" released by "delete_volume" :: held 1.122s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Acquiring lock "cinder-d484ad77-d294-45ef-a507-88e9404a23a7-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "cinder-d484ad77-d294-45ef-a507-88e9404a23a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created reservations ['cc934c48-e157-443a-a6d7-78d3bb57a91d', '82dd7725-ca58-46a7-9dac-0180554f1bf3', 'cce0d8bc-9496-4dd3-ba97-4c1e594bfd28', 'a8ecaa9b-0330-4b9f-8306-075126bfa9f0'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Acquiring lock "cinder-quobyte-d484ad77-d294-45ef-a507-88e9404a23a7" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "cinder-quobyte-d484ad77-d294-45ef-a507-88e9404a23a7" acquired by "delete_volume" :: waited 0.053s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefee5e9-9e57-4969-b0af-7d047c4b8f8a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:36 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:36 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:36 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 Nov 01 09:01:36 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:37 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.652s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Deleted volume successfully. Nov 01 09:01:37 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7" returned: 0 in 0.776s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-48653bfa-144e-4d6b-baf9-3dfcfc1026b8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-26c57fa9-2f07-4d91-ac9a-b4d38d58e8b0-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:37 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7 Nov 01 09:01:37 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-502956ee-249b-4f45-9bc6-32c6cf8c530b-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-502956ee-249b-4f45-9bc6-32c6cf8c530b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-502956ee-249b-4f45-9bc6-32c6cf8c530b" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-502956ee-249b-4f45-9bc6-32c6cf8c530b" acquired by "delete_volume" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1188ee8-62fc-46c7-9418-6e19bd6d7a91]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:37 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d484ad77-d294-45ef-a507-88e9404a23a7" returned: 0 in 0.518s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "cinder-quobyte-d484ad77-d294-45ef-a507-88e9404a23a7" released by "delete_volume" :: held 1.400s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Created reservations ['8e7abff6-2134-4243-99fa-9798a33a25d5', '7892a8d1-abce-4823-a6d1-308c5b156e5e', '821261e0-0891-4149-90f8-490e172240df', 'd26cee06-5006-4b3b-8030-ccaff3362ec1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:38 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b Nov 01 09:01:38 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:38 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:38 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:38 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.391s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:38 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Deleted volume successfully. Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b" returned: 0 in 0.872s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:38 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b Nov 01 09:01:38 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5aa0c766-079f-4511-95e2-0474568295e1 tempest-VolumesCloneNegativeTest-2074578671 None] Lock "cinder-d484ad77-d294-45ef-a507-88e9404a23a7-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:39 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-502956ee-249b-4f45-9bc6-32c6cf8c530b" returned: 0 in 0.526s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-502956ee-249b-4f45-9bc6-32c6cf8c530b" released by "delete_volume" :: held 1.484s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created reservations ['f02f28ec-c6f5-40e1-86fb-2d51feb082db', '47e88aa0-dc6b-4bd7-9ed6-8d68c91e28aa', '27399fd5-db42-4b46-8c1e-05184927b2e3', '20e857d9-ba7b-4d19-89aa-a067decb38b9'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:39 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:39 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:39 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.461s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Deleted volume successfully. Nov 01 09:01:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2ac9fcf3-6b59-4783-8ea0-1d1457e0ecf8 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-502956ee-249b-4f45-9bc6-32c6cf8c530b-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-b4ec1cd8-98d5-488f-8570-b053eac85cf7-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-b4ec1cd8-98d5-488f-8570-b053eac85cf7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-b4ec1cd8-98d5-488f-8570-b053eac85cf7" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-b4ec1cd8-98d5-488f-8570-b053eac85cf7" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e622b-ed98-4f0c-81f2-df3c303cf90d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:40 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 Nov 01 09:01:40 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:40 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7" returned: 0 in 0.541s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:40 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7 Nov 01 09:01:40 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:41 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b4ec1cd8-98d5-488f-8570-b053eac85cf7" returned: 0 in 0.422s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-b4ec1cd8-98d5-488f-8570-b053eac85cf7" released by "delete_volume" :: held 1.058s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created reservations ['0b4afb15-346f-4870-8eec-3d0508cb01b0', '9388ce6b-0fb7-445e-8090-5f0f5a5c9e9f', 'baa43e17-35b2-4255-b6b4-79e47117bce1', 'e7abe590-f278-48e4-8b98-caa530be74b8'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:41 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:41 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:41 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.298s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Deleted volume successfully. Nov 01 09:01:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daf6bf4c-7f99-4ef2-bf09-f6cb48f3e42d tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-b4ec1cd8-98d5-488f-8570-b053eac85cf7-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-981a8616-b3db-4819-8d2c-2cfb70f60e66-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-981a8616-b3db-4819-8d2c-2cfb70f60e66-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-981a8616-b3db-4819-8d2c-2cfb70f60e66" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-981a8616-b3db-4819-8d2c-2cfb70f60e66" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c303c-6ca6-4edc-a51f-32e6ec018fd7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:42 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 Nov 01 09:01:42 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:43 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66" returned: 0 in 0.500s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:43 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66 Nov 01 09:01:43 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:43 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-981a8616-b3db-4819-8d2c-2cfb70f60e66" returned: 0 in 0.281s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-981a8616-b3db-4819-8d2c-2cfb70f60e66" released by "delete_volume" :: held 0.843s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created reservations ['08fc8489-fb73-49b5-b402-9259cba1e91f', 'd4df45cb-e441-4829-8b6b-0574a0a9bc81', 'a13287a9-e856-4284-a828-6732ac5aaea9', '092762a0-cab2-44ce-ba6e-9770fd8ea0bc'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:43 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:43 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-2db22af3-6b6f-4809-a82f-1a29f0700784-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-2db22af3-6b6f-4809-a82f-1a29f0700784-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-2db22af3-6b6f-4809-a82f-1a29f0700784" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-2db22af3-6b6f-4809-a82f-1a29f0700784" acquired by "delete_volume" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1823d-f5dc-4fb7-bb26-deefd9303e10]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:43 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.342s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Deleted volume successfully. Nov 01 09:01:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bb4ac38-e7c8-4703-8203-ec924afd64a9 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-981a8616-b3db-4819-8d2c-2cfb70f60e66-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:44 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 Nov 01 09:01:44 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:44 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784" returned: 0 in 0.519s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:44 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784 Nov 01 09:01:44 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Flow 'volume_create_manager' (c5d1e527-ab51-42ae-8c7a-3b51df3b0553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109371db-03a7-440b-adfe-da0e3179239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109371db-03a7-440b-adfe-da0e3179239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-304797354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f1208-6afd-48b6-8761-8ce6574f7f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbe1a6f0d5b49258e4ed19a8015c187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:44Z,use_quota=True,user_id='03ccedb90acf4449812b7eecdb4e0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb04458-d098-4794-be23-4cdd33f62054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb04458-d098-4794-be23-4cdd33f62054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9244d039-7028-41d6-91ae-69e7fefcec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9244d039-7028-41d6-91ae-69e7fefcec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9f1208-6afd-48b6-8761-8ce6574f7f3d', 'volume_name': 'volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d', 'volume_size': 2}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c283a98d-670d-444c-ac66-7499edf63238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c283a98d-670d-444c-ac66-7499edf63238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab7c668-15d5-495e-9c8c-3934716d7b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:44 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Volume 7f9f1208-6afd-48b6-8761-8ce6574f7f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d', 'volume_size': 2} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-304797354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9f1208-6afd-48b6-8761-8ce6574f7f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbe1a6f0d5b49258e4ed19a8015c187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:44Z,use_quota=True,user_id='03ccedb90acf4449812b7eecdb4e0d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Creating volume 7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:44 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d 2147483648 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:44 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d 2147483648 Nov 01 09:01:44 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:44 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2db22af3-6b6f-4809-a82f-1a29f0700784" returned: 0 in 0.318s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-2db22af3-6b6f-4809-a82f-1a29f0700784" released by "delete_volume" :: held 0.909s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created reservations ['57057cf3-bbc4-4789-8767-dcdf5b753163', '05d9a448-c278-4344-a32e-b59e82bc6987', '5e9ca8d2-2820-4cb8-a085-c458ae7f6c92', 'd7820fc7-3a8c-436f-b6b4-1d20e7ff25ca'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:44 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:44 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-02bd4af1-ff8b-465b-8a8e-42d3a35d2a30-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-02bd4af1-ff8b-465b-8a8e-42d3a35d2a30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-9705e647-85d1-495c-b4e6-d55a00f03fc2" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-9705e647-85d1-495c-b4e6-d55a00f03fc2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Deleting offline snapshot 02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 of volume 9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] snapshot_file for this snap is: volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ba66e-6ce8-465a-99da-433b2c0d76e1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:45 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d 2147483648" returned: 0 in 0.676s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:45 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:45 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 Nov 01 09:01:45 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Deleted volume successfully. Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:45 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-205a2d19-0d25-4100-8205-b33d241b0686 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-2db22af3-6b6f-4809-a82f-1a29f0700784-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:45 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:45 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" returned: 0 in 0.524s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:45 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9705e647-85d1-495c-b4e6-d55a00f03fc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a19ab4-75ea-4397-bafb-2333f703aaf9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab7c668-15d5-495e-9c8c-3934716d7b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d', 'volume_size': 2}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be04900-c34e-4973-8edc-91fcb70b9ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:45 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Volume volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d (7f9f1208-6afd-48b6-8761-8ce6574f7f3d): created successfully Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be04900-c34e-4973-8edc-91fcb70b9ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Flow 'volume_create_manager' (c5d1e527-ab51-42ae-8c7a-3b51df3b0553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3df656d1-73e8-4bdf-ab93-928b3aa0b0a7 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Created volume successfully. Nov 01 09:01:45 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 Nov 01 09:01:45 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:46 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2" returned: 0 in 0.412s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:46 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 Nov 01 09:01:46 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:46 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" returned: 0 in 0.353s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:46 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30 Nov 01 09:01:46 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:46 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2.02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" returned: 0 in 0.339s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-02bd4af1-ff8b-465b-8a8e-42d3a35d2a30" released by "_delete_snapshot" :: held 1.789s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-9705e647-85d1-495c-b4e6-d55a00f03fc2" released by "delete_snapshot" :: held 1.823s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Creating offline snapshot 066c90f1-12ad-4516-9fbe-63e7e97f8553 of volume 7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af9fcc-3b36-4dca-81a0-4ca76063d0a3]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created reservations ['a1b17d3f-0953-48ac-b028-80cd1298cc0b', '58728e85-4775-4215-a7ec-1a4303646251', 'ccedfedd-b58a-431c-ba48-acb307d7fc20', 'c2b05241-795e-451c-986f-c246b91f54bd'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Delete snapshot completed successfully. Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2bd84f24-ae4d-4106-a73b-97f2c3e4f37c tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-02bd4af1-ff8b-465b-8a8e-42d3a35d2a30-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:47 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d Nov 01 09:01:47 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-9705e647-85d1-495c-b4e6-d55a00f03fc2-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-9705e647-85d1-495c-b4e6-d55a00f03fc2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "cinder-quobyte-9705e647-85d1-495c-b4e6-d55a00f03fc2" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-9705e647-85d1-495c-b4e6-d55a00f03fc2" acquired by "delete_volume" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[519ac722-e1a1-4e15-89a5-681619b68d73]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:47 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" returned: 0 in 0.452s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 2G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:47 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 2G Nov 01 09:01:47 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:47 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 Nov 01 09:01:47 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:47 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2" returned: 0 in 0.404s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:47 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2 Nov 01 09:01:47 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:47 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 2G" returned: 0 in 0.541s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:48 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 Nov 01 09:01:48 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:48 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9705e647-85d1-495c-b4e6-d55a00f03fc2" returned: 0 in 0.358s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-quobyte-9705e647-85d1-495c-b4e6-d55a00f03fc2" released by "delete_volume" :: held 0.836s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Created reservations ['1755e446-e729-45cd-9648-b536e1297a91', '3e2d62d5-85b0-4434-b075-e3f7787d48cf', '579c118f-0466-457e-96d5-6469bb93b291', '0d0c7a8e-101c-4b66-8cb9-26ee18f2e456'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:48 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:48 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:48 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553" returned: 0 in 0.423s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:48 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 is being set with open permissions: ugo+rw Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:48 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 Nov 01 09:01:48 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:48 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553" returned: 0 in 0.300s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:48 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.466s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:48 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Deleted volume successfully. Nov 01 09:01:48 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.info Nov 01 09:01:48 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b69cde51-0462-4dca-be4b-bb82f8d4ae63 tempest-CreateVolumesFromSnapshotTest-1487674779 None] Lock "cinder-9705e647-85d1-495c-b4e6-d55a00f03fc2-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:49 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.info" returned: 0 in 0.344s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:49 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.info is being set with open permissions: ugo+rw Nov 01 09:01:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:49 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.info Nov 01 09:01:49 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:49 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.info" returned: 0 in 0.276s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-62f4d5cb-bf8b-4fe9-aaba-7748c682edb4 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Create snapshot completed successfully Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "cinder-066c90f1-12ad-4516-9fbe-63e7e97f8553-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-066c90f1-12ad-4516-9fbe-63e7e97f8553-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "cinder-quobyte-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-quobyte-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "cinder-quobyte-066c90f1-12ad-4516-9fbe-63e7e97f8553" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-quobyte-066c90f1-12ad-4516-9fbe-63e7e97f8553" acquired by "_delete_snapshot" :: waited 0.072s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Deleting offline snapshot 066c90f1-12ad-4516-9fbe-63e7e97f8553 of volume 7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] snapshot_file for this snap is: volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ba2d5-6c58-4cec-8edb-e37ebcbd5962]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:50 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 Nov 01 09:01:50 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:51 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553" returned: 0 in 0.491s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:01:51 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd003eac-a2d2-409d-8fac-61c6bfccb965]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:51 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d Nov 01 09:01:51 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:51 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" returned: 0 in 0.617s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:51 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 Nov 01 09:01:51 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:52 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553" returned: 0 in 0.452s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:52 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553 Nov 01 09:01:52 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:52 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d.066c90f1-12ad-4516-9fbe-63e7e97f8553" returned: 0 in 0.350s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-quobyte-066c90f1-12ad-4516-9fbe-63e7e97f8553" released by "_delete_snapshot" :: held 2.147s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-quobyte-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" released by "delete_snapshot" :: held 2.243s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:52 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Created reservations ['fed403e5-4edf-41b2-ad09-dc927a9b13fe', '21b10946-6a98-4e66-9b9c-40ed318eb0ee', '81bf3bbc-3978-4456-8281-53d30c64261f', '83349429-0a4e-4ba8-897f-fd7b30da8294'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Delete snapshot completed successfully. Nov 01 09:01:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e1d3b69d-e80e-4bf2-80cf-c9394b580948 tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-066c90f1-12ad-4516-9fbe-63e7e97f8553-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Flow 'volume_create_manager' (e8cc0fb8-9e04-4b49-82a5-4d5b8fd3b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f3ccee-2abf-4676-8efd-a3830b40f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f3ccee-2abf-4676-8efd-a3830b40f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1860794327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0effb830-0a8f-42d1-a49e-fd8fa8d4abf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93928bb7d8a348e1af0abaa03416b32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:53Z,use_quota=True,user_id='53862af1b1ee4713aceb00b1301a14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478ee3e6-6523-4501-8105-5252c1e8431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478ee3e6-6523-4501-8105-5252c1e8431b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321446c4-1395-4d5e-a240-b0e6d2e09cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321446c4-1395-4d5e-a240-b0e6d2e09cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0effb830-0a8f-42d1-a49e-fd8fa8d4abf1', 'volume_name': 'volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f534bb-5d34-43ed-84d2-286713ec3359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f534bb-5d34-43ed-84d2-286713ec3359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64145398-301b-4c9e-8833-e9838ae6bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:53 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Volume 0effb830-0a8f-42d1-a49e-fd8fa8d4abf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1', 'volume_size': 1} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1860794327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0effb830-0a8f-42d1-a49e-fd8fa8d4abf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93928bb7d8a348e1af0abaa03416b32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:53Z,use_quota=True,user_id='53862af1b1ee4713aceb00b1301a14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Creating volume 0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:53 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:53 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 1073741824 Nov 01 09:01:53 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "cinder-7f9f1208-6afd-48b6-8761-8ce6574f7f3d-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-7f9f1208-6afd-48b6-8761-8ce6574f7f3d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "cinder-quobyte-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-quobyte-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb06f13-8731-43bb-804b-b87c1eb8214c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Flow 'volume_create_manager' (287d266b-71cb-49b0-952b-8cd53e2b0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ddb23f-787b-4035-be55-6ceab9eadf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ddb23f-787b-4035-be55-6ceab9eadf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895820740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaa2a7d-0975-4fc5-803e-25526fa75846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633b132ba09447fe83cd21fce7693a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:54Z,use_quota=True,user_id='95d6e1c22d4d4cd4b62d9a8cf6e6db02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defebf18-8fea-4997-a63a-0722d41244db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defebf18-8fea-4997-a63a-0722d41244db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9914f635-f913-4b8e-a52f-ed8a834e7bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9914f635-f913-4b8e-a52f-ed8a834e7bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aaa2a7d-0975-4fc5-803e-25526fa75846', 'volume_name': 'volume-6aaa2a7d-0975-4fc5-803e-25526fa75846', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fde7d7-4335-4ce7-8036-bda644f9c95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fde7d7-4335-4ce7-8036-bda644f9c95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094bd49a-c69e-4389-a036-71c1aef10044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:54 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Volume 6aaa2a7d-0975-4fc5-803e-25526fa75846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aaa2a7d-0975-4fc5-803e-25526fa75846', 'volume_size': 1} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:54 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d Nov 01 09:01:54 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:54 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 1073741824" returned: 0 in 0.586s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:54 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 Nov 01 09:01:54 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:54 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" returned: 0 in 0.461s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:54 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d Nov 01 09:01:54 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:54 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1895820740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aaa2a7d-0975-4fc5-803e-25526fa75846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633b132ba09447fe83cd21fce7693a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:54Z,use_quota=True,user_id='95d6e1c22d4d4cd4b62d9a8cf6e6db02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Creating volume 6aaa2a7d-0975-4fc5-803e-25526fa75846 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:54 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64145398-301b-4c9e-8833-e9838ae6bafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d83ea22-9241-4644-ba39-3c2ce0e4b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:54 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 1073741824 Nov 01 09:01:54 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:54 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Volume volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 (0effb830-0a8f-42d1-a49e-fd8fa8d4abf1): created successfully Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d83ea22-9241-4644-ba39-3c2ce0e4b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Flow 'volume_create_manager' (e8cc0fb8-9e04-4b49-82a5-4d5b8fd3b271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c694cd33-d426-437e-86a6-a89f806c68e1 tempest-AttachVolumeNegativeTest-572358819 None] Created volume successfully. Nov 01 09:01:54 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" returned: 0 in 0.459s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-quobyte-7f9f1208-6afd-48b6-8761-8ce6574f7f3d" released by "delete_volume" :: held 1.019s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:54 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Created reservations ['af28564a-9454-4490-860c-9e9c8d140cc3', 'a8356f59-3c43-4fd7-9e5f-3a65c52546c0', 'f7fa1a0d-7ab7-4703-8478-4f1844b60b13', 'c75c333a-eb10-4763-a2ff-b3db6bf225bf'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:55 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:55 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:55 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 1073741824" returned: 0 in 0.652s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:55 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 Nov 01 09:01:55 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:55 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Deleted volume successfully. Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93c0eb72-be08-404a-beb1-9ca36f61e48d tempest-VolumesSnapshotNegativeTestJSON-1262318643 None] Lock "cinder-7f9f1208-6afd-48b6-8761-8ce6574f7f3d-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:55 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846" returned: 0 in 0.268s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094bd49a-c69e-4389-a036-71c1aef10044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aaa2a7d-0975-4fc5-803e-25526fa75846', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713752f3-0a14-4226-b17e-4c9e033966c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:55 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Volume volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 (6aaa2a7d-0975-4fc5-803e-25526fa75846): created successfully Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713752f3-0a14-4226-b17e-4c9e033966c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Flow 'volume_create_manager' (287d266b-71cb-49b0-952b-8cd53e2b0d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fcd0af1b-7a92-45df-b4ec-a438af1a9f04 tempest-ProjectReaderTests-297809773 None] Created volume successfully. Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Flow 'volume_create_manager' (d2692407-ed3b-4273-9965-8f0f94c53e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef6c7e8-bad2-4561-aa66-00f302362795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef6c7e8-bad2-4561-aa66-00f302362795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-148181888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11100cee-959b-4969-8c2a-4de535293085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882c6ed929da4df8b66577399a6ff398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:56Z,use_quota=True,user_id='26e9d388933a45cf80debae505c4b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1f7675-c8bf-4506-86d0-a856ee527101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1f7675-c8bf-4506-86d0-a856ee527101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d24d230-5789-4615-b981-ef5e839ee300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d24d230-5789-4615-b981-ef5e839ee300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11100cee-959b-4969-8c2a-4de535293085', 'volume_name': 'volume-11100cee-959b-4969-8c2a-4de535293085', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a4d4b8-2a20-46d1-8d56-828ba52375cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a4d4b8-2a20-46d1-8d56-828ba52375cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f4c78b-3b1c-4a94-9d56-cac6a2e90021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:56 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Volume 11100cee-959b-4969-8c2a-4de535293085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11100cee-959b-4969-8c2a-4de535293085', 'volume_size': 1} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-148181888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11100cee-959b-4969-8c2a-4de535293085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882c6ed929da4df8b66577399a6ff398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:56Z,use_quota=True,user_id='26e9d388933a45cf80debae505c4b9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Creating volume 11100cee-959b-4969-8c2a-4de535293085 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:56 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:56 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 1073741824 Nov 01 09:01:56 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Acquiring lock "cinder-6aaa2a7d-0975-4fc5-803e-25526fa75846-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Lock "cinder-6aaa2a7d-0975-4fc5-803e-25526fa75846-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Acquiring lock "cinder-quobyte-6aaa2a7d-0975-4fc5-803e-25526fa75846" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Lock "cinder-quobyte-6aaa2a7d-0975-4fc5-803e-25526fa75846" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1685c44-0885-48af-9e7b-645a2d734862]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:56 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 Nov 01 09:01:56 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-88d64611-1f4a-43de-a3fc-512d537e2653 req-ecb9379b-28f9-49aa-aef5-c1ce8d82bd33 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:57 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 1073741824" returned: 0 in 0.840s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:57 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 Nov 01 09:01:57 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:57 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846" returned: 0 in 0.662s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:57 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846 Nov 01 09:01:57 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:57 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085" returned: 0 in 0.366s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-88d64611-1f4a-43de-a3fc-512d537e2653 req-ecb9379b-28f9-49aa-aef5-c1ce8d82bd33 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.505s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f4c78b-3b1c-4a94-9d56-cac6a2e90021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11100cee-959b-4969-8c2a-4de535293085', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebafa4fc-51ff-45bb-8ce2-808737f59190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-88d64611-1f4a-43de-a3fc-512d537e2653 req-ecb9379b-28f9-49aa-aef5-c1ce8d82bd33 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:57 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Volume volume-11100cee-959b-4969-8c2a-4de535293085 (11100cee-959b-4969-8c2a-4de535293085): created successfully Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebafa4fc-51ff-45bb-8ce2-808737f59190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Flow 'volume_create_manager' (d2692407-ed3b-4273-9965-8f0f94c53e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c8b4336f-3f97-442e-b466-c42dcc91e2d5 tempest-TestImageHashVerification-275340402 None] Created volume successfully. Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-88d64611-1f4a-43de-a3fc-512d537e2653 req-ecb9379b-28f9-49aa-aef5-c1ce8d82bd33 tempest-AttachVolumeNegativeTest-572358819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '096196b9-05aa-4bcb-a890-a15f0bd42762', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:01:57 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-6aaa2a7d-0975-4fc5-803e-25526fa75846" returned: 0 in 0.418s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Lock "cinder-quobyte-6aaa2a7d-0975-4fc5-803e-25526fa75846" released by "delete_volume" :: held 1.192s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-88d64611-1f4a-43de-a3fc-512d537e2653 req-ecb9379b-28f9-49aa-aef5-c1ce8d82bd33 tempest-AttachVolumeNegativeTest-572358819 None] attachment_update completed successfully. Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Created reservations ['4ae47365-242e-4ac9-925d-6130ede7eb77', 'b8a0cfd7-c6a6-4981-9fee-9df4995bf1bc', '0ddad8cf-3a75-4d7c-8723-edafec2fee9c', 'c09c834f-3bdd-41cb-a835-31133fbda4fd'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:57 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:01:57 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:58 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Nov 01 09:01:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.396s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:01:58 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:01:58 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Deleted volume successfully. Nov 01 09:01:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e601311d-9b14-49e1-ad31-5cb49a4ff441 tempest-ProjectReaderTests-297809773 None] Lock "cinder-6aaa2a7d-0975-4fc5-803e-25526fa75846-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Flow 'volume_create_manager' (e1d95892-76da-48f6-a5a8-6d77618d118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc8ea58-dfcc-4531-846c-94e9a28a7633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc8ea58-dfcc-4531-846c-94e9a28a7633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736191026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1241c063-4aa7-414f-8b67-e5ce03303d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633b132ba09447fe83cd21fce7693a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:59Z,use_quota=True,user_id='95d6e1c22d4d4cd4b62d9a8cf6e6db02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2212ff11-96ea-48da-9533-5698c685743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2212ff11-96ea-48da-9533-5698c685743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0139530d-f543-4c9a-a80c-c13a689abe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0139530d-f543-4c9a-a80c-c13a689abe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1241c063-4aa7-414f-8b67-e5ce03303d38', 'volume_name': 'volume-1241c063-4aa7-414f-8b67-e5ce03303d38', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8538a9-d918-494d-af1d-fcdbb41b8fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8538a9-d918-494d-af1d-fcdbb41b8fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ddc71b-92f4-4436-8ac1-ecbba816cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:01:59 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Volume 1241c063-4aa7-414f-8b67-e5ce03303d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1241c063-4aa7-414f-8b67-e5ce03303d38', 'volume_size': 1} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1736191026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1241c063-4aa7-414f-8b67-e5ce03303d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633b132ba09447fe83cd21fce7693a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:01:59Z,use_quota=True,user_id='95d6e1c22d4d4cd4b62d9a8cf6e6db02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Creating volume 1241c063-4aa7-414f-8b67-e5ce03303d38 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:01:59 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:01:59 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 1073741824 Nov 01 09:01:59 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:01:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:00 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 1073741824" returned: 0 in 0.675s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:00 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 Nov 01 09:02:00 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:00 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38" returned: 0 in 0.311s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.804s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ddc71b-92f4-4436-8ac1-ecbba816cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1241c063-4aa7-414f-8b67-e5ce03303d38', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac495c43-38ce-4132-ab24-5daa68e6531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f42ebaa-6135-4d0e-ba22-edd77ebaa42b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Volume volume-1241c063-4aa7-414f-8b67-e5ce03303d38 (1241c063-4aa7-414f-8b67-e5ce03303d38): created successfully Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac495c43-38ce-4132-ab24-5daa68e6531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Flow 'volume_create_manager' (e1d95892-76da-48f6-a5a8-6d77618d118f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:02:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-02b04f55-4aa4-4856-a723-081146b48a6f tempest-ProjectReaderTests-297809773 None] Created volume successfully. Nov 01 09:02:00 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 Nov 01 09:02:00 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:01 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085" returned: 0 in 0.473s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c97e0c-0284-4cb5-ba01-85bf5e738f22]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:01 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 Nov 01 09:02:01 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:01 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085" returned: 0 in 0.435s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 /opt/stack/data/cinder/conversion/11100cee-959b-4969-8c2a-4de535293085.temp_image.c05869e4-d40f-4863-9b79-9e2d62e55ac2z5x7up_k.img {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:01 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 /opt/stack/data/cinder/conversion/11100cee-959b-4969-8c2a-4de535293085.temp_image.c05869e4-d40f-4863-9b79-9e2d62e55ac2z5x7up_k.img Nov 01 09:02:01 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Acquiring lock "cinder-1241c063-4aa7-414f-8b67-e5ce03303d38-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Lock "cinder-1241c063-4aa7-414f-8b67-e5ce03303d38-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Acquiring lock "cinder-quobyte-1241c063-4aa7-414f-8b67-e5ce03303d38" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Lock "cinder-quobyte-1241c063-4aa7-414f-8b67-e5ce03303d38" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c4c0ce-d85c-4cd4-a580-0b4478e22cb2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:02 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 Nov 01 09:02:02 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:02 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38" returned: 0 in 1.030s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:02 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38 Nov 01 09:02:02 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:03 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1241c063-4aa7-414f-8b67-e5ce03303d38" returned: 0 in 0.512s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Lock "cinder-quobyte-1241c063-4aa7-414f-8b67-e5ce03303d38" released by "delete_volume" :: held 1.638s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Created reservations ['44e1188b-72a1-4dcb-8eda-1de6e6f077ca', '650c4076-60f1-4042-bf47-7c04941b5736', '187ffd02-c6ab-4dc1-b324-8917775af3ce', '9a508b9e-7962-4536-b290-4f51d727ba1b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:03 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:02:03 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:04 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.658s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:04 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:02:04 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Deleted volume successfully. Nov 01 09:02:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-24b64795-c854-4e66-ada7-0d3a9bf1a3fc tempest-ProjectReaderTests-297809773 None] Lock "cinder-1241c063-4aa7-414f-8b67-e5ce03303d38-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:02:10 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 /opt/stack/data/cinder/conversion/11100cee-959b-4969-8c2a-4de535293085.temp_image.c05869e4-d40f-4863-9b79-9e2d62e55ac2z5x7up_k.img" returned: 0 in 9.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4702c1-b355-4eb8-b5f3-ed04c8137c9b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:11 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 Nov 01 09:02:11 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:11 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085" returned: 0 in 0.749s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:11 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085, size 1024.00 MB, duration 9.28 sec, destination /opt/stack/data/cinder/conversion/11100cee-959b-4969-8c2a-4de535293085.temp_image.c05869e4-d40f-4863-9b79-9e2d62e55ac2z5x7up_k.img {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:02:11 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Converted 1024.00 MB image at 110.39 MB/s Nov 01 09:02:11 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] c05869e4-d40f-4863-9b79-9e2d62e55ac2 was raw, no need to convert to raw {{(pid=86770) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:21 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:02:21 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=155,cinder:SELECT=117,cinder:INSERT=36,cinder:DELETE=15 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=147,cinder:SELECT=104,cinder:INSERT=35,cinder:DELETE=12 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:02:21 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.517s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:02:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:02:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.912s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Uploaded volume to glance image-id: c05869e4-d40f-4863-9b79-9e2d62e55ac2. {{(pid=86770) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 09:02:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-38b2a25d-68dd-4059-8091-5955294354a7 tempest-TestImageHashVerification-275340402 None] Copy volume to image completed successfully. Nov 01 09:02:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Acquiring lock "cinder-11100cee-959b-4969-8c2a-4de535293085-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:02:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Lock "cinder-11100cee-959b-4969-8c2a-4de535293085-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:02:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Acquiring lock "cinder-quobyte-11100cee-959b-4969-8c2a-4de535293085" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:02:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Lock "cinder-quobyte-11100cee-959b-4969-8c2a-4de535293085" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:02:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbd0787-6370-4ae1-9476-e53bd3d02727]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:44 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 Nov 01 09:02:44 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:45 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085" returned: 0 in 0.435s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:45 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085 Nov 01 09:02:45 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:45 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-11100cee-959b-4969-8c2a-4de535293085" returned: 0 in 0.318s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Lock "cinder-quobyte-11100cee-959b-4969-8c2a-4de535293085" released by "delete_volume" :: held 0.815s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Created reservations ['cae168a6-9cca-4c2a-bdc4-bc2661c98677', '8fada9bb-027b-4765-b12b-034d83ae91e3', '1b853ad6-28a7-4397-925c-13d158dbe2be', '7e002c41-008e-4d4e-868e-7693c77e9617'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:45 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:02:45 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:46 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.353s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:46 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:02:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Deleted volume successfully. Nov 01 09:02:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c87c18d3-98df-4c23-9c66-bb6efff65bc4 tempest-TestImageHashVerification-275340402 None] Lock "cinder-11100cee-959b-4969-8c2a-4de535293085-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Flow 'volume_create_manager' (47c299f7-3aef-464b-a65b-90fc586574e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dcd78c-77aa-4b4d-b33d-bbf4e67c1ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2dcd78c-77aa-4b4d-b33d-bbf4e67c1ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-999384503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc1a406-b23d-4114-a1dd-85ddd3bd6bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75148f3128534181b76760841d3326e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:02:49Z,use_quota=True,user_id='7e2c74b3e73a4f0d9d78ad3ff3c6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b049e1fb-fe98-439c-94f9-5333c90416b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b049e1fb-fe98-439c-94f9-5333c90416b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93af3351-177e-45bb-a455-5acc0a2c4fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93af3351-177e-45bb-a455-5acc0a2c4fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc1a406-b23d-4114-a1dd-85ddd3bd6bd8', 'volume_name': 'volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45486295-35c4-47ec-b8db-64b94e0919dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45486295-35c4-47ec-b8db-64b94e0919dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3173c0c2-f0b4-456a-8e69-a75f8dcfd150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Volume afc1a406-b23d-4114-a1dd-85ddd3bd6bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8', 'volume_size': 1} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-999384503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc1a406-b23d-4114-a1dd-85ddd3bd6bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75148f3128534181b76760841d3326e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:02:49Z,use_quota=True,user_id='7e2c74b3e73a4f0d9d78ad3ff3c6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Creating volume afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:02:49 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:49 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 1073741824 Nov 01 09:02:49 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:49 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 1073741824" returned: 0 in 0.638s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:50 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 Nov 01 09:02:50 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:50 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" returned: 0 in 0.381s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3173c0c2-f0b4-456a-8e69-a75f8dcfd150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94683686-ed60-444c-b7ac-748330df935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Volume volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 (afc1a406-b23d-4114-a1dd-85ddd3bd6bd8): created successfully Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94683686-ed60-444c-b7ac-748330df935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Flow 'volume_create_manager' (47c299f7-3aef-464b-a65b-90fc586574e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:02:50 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0084168b-3d99-4367-ac37-871329fa4d82 tempest-SnapshotDependencyTests-74035807 None] Created volume successfully. Nov 01 09:02:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Creating offline snapshot 5909c868-3b48-48b0-af2e-5424076654bf of volume afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:02:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e68e48-938d-4320-be46-346c0b8772dd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:52 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 Nov 01 09:02:52 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:52 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" returned: 0 in 0.650s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:52 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf 1G Nov 01 09:02:52 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:53 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf 1G" returned: 0 in 0.943s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:53 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf Nov 01 09:02:53 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:54 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf" returned: 0 in 0.579s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:54 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf is being set with open permissions: ugo+rw Nov 01 09:02:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:54 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf Nov 01 09:02:54 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:54 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf" returned: 0 in 0.333s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:54 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.info Nov 01 09:02:54 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:55 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.info" returned: 0 in 0.354s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:55 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.info is being set with open permissions: ugo+rw Nov 01 09:02:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:55 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.info Nov 01 09:02:55 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:55 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.info" returned: 0 in 0.285s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.333s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-af084104-8b09-4644-bace-c916d7a5eec2 tempest-SnapshotDependencyTests-74035807 None] Create snapshot completed successfully Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Flow 'volume_create_manager' (42455ce9-f67f-43e7-b71d-65a9ce7478bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd87240d-daa2-40d8-9305-8fbd4c9638f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd87240d-daa2-40d8-9305-8fbd4c9638f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32e1c82-d334-450c-b5c2-293b02846035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75148f3128534181b76760841d3326e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5909c868-3b48-48b0-af2e-5424076654bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:02:57Z,use_quota=True,user_id='7e2c74b3e73a4f0d9d78ad3ff3c6a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7ee81e-25bb-4685-8e39-d83f968a6d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7ee81e-25bb-4685-8e39-d83f968a6d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a717b58-4170-4680-a28f-9c78804f183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a717b58-4170-4680-a28f-9c78804f183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e32e1c82-d334-450c-b5c2-293b02846035', 'volume_name': 'volume-e32e1c82-d334-450c-b5c2-293b02846035', 'volume_size': 1, 'snapshot_id': '5909c868-3b48-48b0-af2e-5424076654bf'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d28501a-1510-4884-bace-6c785ccfeefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d28501a-1510-4884-bace-6c785ccfeefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c978036-2474-4882-8f9c-d20cab7a877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:02:57 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Volume e32e1c82-d334-450c-b5c2-293b02846035: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e32e1c82-d334-450c-b5c2-293b02846035', 'volume_size': 1, 'snapshot_id': '5909c868-3b48-48b0-af2e-5424076654bf'} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-quobyte-5909c868-3b48-48b0-af2e-5424076654bf-e32e1c82-d334-450c-b5c2-293b02846035" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-5909c868-3b48-48b0-af2e-5424076654bf-e32e1c82-d334-450c-b5c2-293b02846035" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Creating volume e32e1c82-d334-450c-b5c2-293b02846035 from snapshot 5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-quobyte-e32e1c82-d334-450c-b5c2-293b02846035" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-e32e1c82-d334-450c-b5c2-293b02846035" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] snapshot: 5909c868-3b48-48b0-af2e-5424076654bf, volume: e32e1c82-d334-450c-b5c2-293b02846035, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48157c2-f0ef-4ecf-8c14-20711962d2f6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:57 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf Nov 01 09:02:57 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:58 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf" returned: 0 in 0.668s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d95570-cb30-41f8-94f6-232a66150811]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:58 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 Nov 01 09:02:58 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:02:58 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" returned: 0 in 0.542s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:02:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:02:58 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 Nov 01 09:02:58 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-2d5ace26-c0d6-4d7b-9163-8af6d31690b9 req-18ed703b-f12d-45af-aeb7-3127dadd5a66 tempest-AttachVolumeNegativeTest-572358819 None] Terminate volume connection completed successfully. Nov 01 09:03:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2d5ace26-c0d6-4d7b-9163-8af6d31690b9 req-18ed703b-f12d-45af-aeb7-3127dadd5a66 tempest-AttachVolumeNegativeTest-572358819 None] Deleting attachment 096196b9-05aa-4bcb-a890-a15f0bd42762. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:03:09 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035" returned: 0 in 10.759s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:09 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8, size 1024.00 MB, duration 10.76 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:03:09 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Converted 1024.00 MB image at 95.15 MB/s Nov 01 09:03:09 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 is being set with open permissions: ugo+rw Nov 01 09:03:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:09 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 Nov 01 09:03:09 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:10 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035" returned: 0 in 0.457s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-e32e1c82-d334-450c-b5c2-293b02846035" released by "_copy_volume_from_snapshot" :: held 12.693s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-5909c868-3b48-48b0-af2e-5424076654bf-e32e1c82-d334-450c-b5c2-293b02846035" released by "_create_volume_from_snapshot" :: held 12.829s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.860s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c978036-2474-4882-8f9c-d20cab7a877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32e1c82-d334-450c-b5c2-293b02846035', 'volume_size': 1, 'snapshot_id': '5909c868-3b48-48b0-af2e-5424076654bf'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8feb4b-b9f9-427d-9289-92cb9356d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:10 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Volume volume-e32e1c82-d334-450c-b5c2-293b02846035 (e32e1c82-d334-450c-b5c2-293b02846035): created successfully Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba8feb4b-b9f9-427d-9289-92cb9356d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Flow 'volume_create_manager' (42455ce9-f67f-43e7-b71d-65a9ce7478bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-dbb19385-c876-4c41-8ca2-5a96387031b3 tempest-SnapshotDependencyTests-74035807 None] Created volume successfully. Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-5909c868-3b48-48b0-af2e-5424076654bf-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-5909c868-3b48-48b0-af2e-5424076654bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-quobyte-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-quobyte-5909c868-3b48-48b0-af2e-5424076654bf" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-5909c868-3b48-48b0-af2e-5424076654bf" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Deleting offline snapshot 5909c868-3b48-48b0-af2e-5424076654bf of volume afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:03:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] snapshot_file for this snap is: volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:03:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef7d054-6105-4e61-8df2-12becfc4d52c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:11 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf Nov 01 09:03:11 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:11 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf" returned: 0 in 0.620s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:03:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fadc1a-b754-460a-a4e6-42c9a240ff5a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:11 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 Nov 01 09:03:11 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:12 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" returned: 0 in 0.925s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:12 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf Nov 01 09:03:12 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:13 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf" returned: 0 in 0.744s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:13 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf Nov 01 09:03:13 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:13 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8.5909c868-3b48-48b0-af2e-5424076654bf" returned: 0 in 0.407s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-5909c868-3b48-48b0-af2e-5424076654bf" released by "_delete_snapshot" :: held 2.946s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" released by "delete_snapshot" :: held 3.019s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:13 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Created reservations ['6074a4a2-d1be-470c-9a93-f0774321b539', '75ffbc20-c69b-4ea9-a286-64fe7d9a4906', 'eed980b9-7244-4186-949a-fb86ab971785', '0ca150e4-726e-44c0-9e66-b0809977a550'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:14 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Delete snapshot completed successfully. Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fd37d22c-6365-4fc1-8ba6-60f532936508 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-5909c868-3b48-48b0-af2e-5424076654bf-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-quobyte-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c631cce-edbf-4ef6-87fc-fe11b31731b8]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:14 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 Nov 01 09:03:14 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:14 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" returned: 0 in 0.465s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:14 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8 Nov 01 09:03:14 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:15 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" returned: 0 in 0.412s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8" released by "delete_volume" :: held 1.001s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Created reservations ['4f94999b-d97b-41e3-b916-97c76bdebee4', '5b79869a-b41b-4999-b1e0-832ee5c15a7b', '910769af-9a44-4df3-9d6a-bd8893f3745f', 'cf362011-4446-4d23-b2ea-91a67105888d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:15 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:15 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:15 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.352s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Deleted volume successfully. Nov 01 09:03:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79d5cccb-5d52-4161-9cc2-bd684c287450 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-afc1a406-b23d-4114-a1dd-85ddd3bd6bd8-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-e32e1c82-d334-450c-b5c2-293b02846035-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-e32e1c82-d334-450c-b5c2-293b02846035-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "cinder-quobyte-e32e1c82-d334-450c-b5c2-293b02846035" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-e32e1c82-d334-450c-b5c2-293b02846035" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:16 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b05ad3-10d3-45e8-8d0f-022a2e3becc9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:16 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 Nov 01 09:03:16 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (52a0bc53-89f5-4cd1-b538-d1c3833dec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e94db1-d793-471c-a83f-40d29915fe1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e94db1-d793-471c-a83f-40d29915fe1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850092604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70adf1df-dcd8-4bc7-9253-9ef958c08f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:17Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f991a7-e560-4f94-a121-f1b9b1f5aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f991a7-e560-4f94-a121-f1b9b1f5aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1ba649-da0a-4366-bfc7-dc6298649327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1ba649-da0a-4366-bfc7-dc6298649327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70adf1df-dcd8-4bc7-9253-9ef958c08f69', 'volume_name': 'volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02764f49-a7c1-4413-8019-d63758284fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02764f49-a7c1-4413-8019-d63758284fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c566baf-841f-4f93-af53-f3e94059da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:17 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Volume 70adf1df-dcd8-4bc7-9253-9ef958c08f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69', 'volume_size': 1} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1850092604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70adf1df-dcd8-4bc7-9253-9ef958c08f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:17Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Creating volume 70adf1df-dcd8-4bc7-9253-9ef958c08f69 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:17 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:17 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035" returned: 0 in 0.760s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:17 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 1073741824 Nov 01 09:03:17 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:17 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035 Nov 01 09:03:17 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (4ad2f31c-6131-49b0-9337-1c2fa08d721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:18 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d48aba-1d2c-4206-b7b1-681334c2c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e32e1c82-d334-450c-b5c2-293b02846035" returned: 0 in 0.909s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d48aba-1d2c-4206-b7b1-681334c2c85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1935809076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1445b544-51ee-47e8-86b4-783b99532fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:18Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2edcf9f-06ad-446f-af6f-28b6d0b01355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2edcf9f-06ad-446f-af6f-28b6d0b01355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c119bb09-23eb-4023-a8e1-bcd395ca2719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c119bb09-23eb-4023-a8e1-bcd395ca2719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1445b544-51ee-47e8-86b4-783b99532fe6', 'volume_name': 'volume-1445b544-51ee-47e8-86b4-783b99532fe6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d2af33-06c4-4c01-9138-7333bf75240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d2af33-06c4-4c01-9138-7333bf75240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62201b4b-54be-47f1-a4fe-f0e976098989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:18 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Volume 1445b544-51ee-47e8-86b4-783b99532fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1445b544-51ee-47e8-86b4-783b99532fe6', 'volume_size': 1} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-quobyte-e32e1c82-d334-450c-b5c2-293b02846035" released by "delete_volume" :: held 1.821s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:18 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 1073741824" returned: 0 in 1.179s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Created reservations ['ee4b6a1e-76f5-4941-adc5-b2f8f31b7e3d', '5f86a2db-186e-4ba8-ac93-94ecebfc1017', '559a212b-3fd7-4888-a8ce-3a386dcfdc31', '3dce6ae3-6f30-4a40-99fb-c88bbb7d297d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:18 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 Nov 01 09:03:18 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:19 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:19 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (563b1183-c933-4e79-ab27-71e92b83d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80087865-91fb-42a8-9acc-4db69ea97a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80087865-91fb-42a8-9acc-4db69ea97a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550753377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3e4fb5-f843-47bd-ae07-b89beb184c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:19Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e861a349-9a9d-4365-9ff4-cf7bc208434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:19 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e861a349-9a9d-4365-9ff4-cf7bc208434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ce44ab-a008-4ef6-bc15-e15eb2bfbe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:19 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ce44ab-a008-4ef6-bc15-e15eb2bfbe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3e4fb5-f843-47bd-ae07-b89beb184c3c', 'volume_name': 'volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c57ee8-ecfa-4dc1-a875-dc25c77ed39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c57ee8-ecfa-4dc1-a875-dc25c77ed39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39afdadf-afba-4529-871d-6549b192b8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:19 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Volume 5c3e4fb5-f843-47bd-ae07-b89beb184c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c', 'volume_size': 1} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.771s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69" returned: 0 in 0.989s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1935809076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1445b544-51ee-47e8-86b4-783b99532fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:18Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Creating volume 1445b544-51ee-47e8-86b4-783b99532fe6 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:19 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Deleted volume successfully. Nov 01 09:03:19 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 1073741824 Nov 01 09:03:19 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c566baf-841f-4f93-af53-f3e94059da14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62ad2ab-4d47-440d-a920-ffa042e08ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:20 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Volume volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 (70adf1df-dcd8-4bc7-9253-9ef958c08f69): created successfully Nov 01 09:03:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62ad2ab-4d47-440d-a920-ffa042e08ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (52a0bc53-89f5-4cd1-b538-d1c3833dec56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7093cb00-b843-4d05-9409-9c50cf809b71 tempest-SnapshotDependencyTests-74035807 None] Lock "cinder-e32e1c82-d334-450c-b5c2-293b02846035-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7261085d-1100-4ead-9424-2a90dee7e87d tempest-CreateVolumesFromImageTest-2061596013 None] Created volume successfully. Nov 01 09:03:20 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 1073741824" returned: 0 in 0.870s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:20 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 Nov 01 09:03:20 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (03d27b5a-56b6-464a-bfe2-2580d912ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c6d107-fed9-4f37-a142-c0e2e151a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c6d107-fed9-4f37-a142-c0e2e151a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161394621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a68a30-1c72-4305-bf34-0736e3de7327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:21Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:21 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:21 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a61de1-c118-4500-9fa6-2e35d67b662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a61de1-c118-4500-9fa6-2e35d67b662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e355c9b-bfe4-4209-95ed-7a3e5271bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e355c9b-bfe4-4209-95ed-7a3e5271bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a68a30-1c72-4305-bf34-0736e3de7327', 'volume_name': 'volume-19a68a30-1c72-4305-bf34-0736e3de7327', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:21 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36210ad7-6dc5-4eaf-9b7e-a59a7d207eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36210ad7-6dc5-4eaf-9b7e-a59a7d207eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada1d28-d2b9-4b0e-a63e-02c5f55f5a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:21 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Volume 19a68a30-1c72-4305-bf34-0736e3de7327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a68a30-1c72-4305-bf34-0736e3de7327', 'volume_size': 1} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6" returned: 0 in 1.138s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550753377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3e4fb5-f843-47bd-ae07-b89beb184c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:19Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Creating volume 5c3e4fb5-f843-47bd-ae07-b89beb184c3c {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:22 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62201b4b-54be-47f1-a4fe-f0e976098989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1445b544-51ee-47e8-86b4-783b99532fe6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341f35c8-7ecc-4d7d-bd06-0bbf9afd0d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:22 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c 1073741824 Nov 01 09:03:22 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:22 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Volume volume-1445b544-51ee-47e8-86b4-783b99532fe6 (1445b544-51ee-47e8-86b4-783b99532fe6): created successfully Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341f35c8-7ecc-4d7d-bd06-0bbf9afd0d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (4ad2f31c-6131-49b0-9337-1c2fa08d721e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:22 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.901s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:22 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d00a4c75-d05d-4ffb-a937-9a173f3a76df tempest-CreateVolumesFromImageTest-2061596013 None] Created volume successfully. Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (798082b1-74d0-4390-8ba1-0637225a81b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fd691f-b428-4dbc-b27e-e411abe8ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00fd691f-b428-4dbc-b27e-e411abe8ea30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-260039623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a21aaf-3567-46fe-b57d-bce3e773b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:22Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dad327-677d-480c-a346-6debf43ba0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dad327-677d-480c-a346-6debf43ba0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2654ea4-f942-4174-b975-da1b22c4a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2654ea4-f942-4174-b975-da1b22c4a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a21aaf-3567-46fe-b57d-bce3e773b97b', 'volume_name': 'volume-41a21aaf-3567-46fe-b57d-bce3e773b97b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52433d96-2f9b-4559-b33d-110a4137ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52433d96-2f9b-4559-b33d-110a4137ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8612b73-99cf-40d4-bf69-fa0a87e412b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:22 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Volume 41a21aaf-3567-46fe-b57d-bce3e773b97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a21aaf-3567-46fe-b57d-bce3e773b97b', 'volume_size': 1} Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:22 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c 1073741824" returned: 0 in 0.867s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:23 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c Nov 01 09:03:23 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:23 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c" returned: 0 in 0.606s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-161394621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a68a30-1c72-4305-bf34-0736e3de7327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:21Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Creating volume 19a68a30-1c72-4305-bf34-0736e3de7327 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:23 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39afdadf-afba-4529-871d-6549b192b8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:23 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 1073741824 Nov 01 09:03:23 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b91c2b-e0a9-44f7-987f-011ffe4cd411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:23 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Volume volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c (5c3e4fb5-f843-47bd-ae07-b89beb184c3c): created successfully Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b91c2b-e0a9-44f7-987f-011ffe4cd411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (563b1183-c933-4e79-ab27-71e92b83d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3c0b7817-2bfb-46c4-9efd-2fd99a8e0d72 tempest-CreateVolumesFromImageTest-2061596013 None] Created volume successfully. Nov 01 09:03:24 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 1073741824" returned: 0 in 0.667s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:24 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 Nov 01 09:03:24 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:24 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327" returned: 0 in 0.289s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.894s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-260039623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a21aaf-3567-46fe-b57d-bce3e773b97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b2337208c548a58363a47ef9427eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:22Z,use_quota=True,user_id='ac3bf6d8d42846f296628bd93d0a9882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Creating volume 41a21aaf-3567-46fe-b57d-bce3e773b97b {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:24 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:24 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b 1073741824 Nov 01 09:03:24 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada1d28-d2b9-4b0e-a63e-02c5f55f5a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a68a30-1c72-4305-bf34-0736e3de7327', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ffbfc9-95ea-47d0-987e-c6d97a84dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Volume volume-19a68a30-1c72-4305-bf34-0736e3de7327 (19a68a30-1c72-4305-bf34-0736e3de7327): created successfully Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ffbfc9-95ea-47d0-987e-c6d97a84dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (03d27b5a-56b6-464a-bfe2-2580d912ce10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b3de47cf-8a3b-4101-83a2-bc70ac059f87 tempest-CreateVolumesFromImageTest-2061596013 None] Created volume successfully. Nov 01 09:03:25 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b 1073741824" returned: 0 in 0.814s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:25 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b Nov 01 09:03:25 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:26 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b" returned: 0 in 0.526s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8612b73-99cf-40d4-bf69-fa0a87e412b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a21aaf-3567-46fe-b57d-bce3e773b97b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb8a6b6-a967-4653-8319-7fe3027cdf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Volume volume-41a21aaf-3567-46fe-b57d-bce3e773b97b (41a21aaf-3567-46fe-b57d-bce3e773b97b): created successfully Nov 01 09:03:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb8a6b6-a967-4653-8319-7fe3027cdf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Flow 'volume_create_manager' (798082b1-74d0-4390-8ba1-0637225a81b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:26 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-411bd21d-0fac-4400-96eb-e6d415a2e3f7 tempest-CreateVolumesFromImageTest-2061596013 None] Created volume successfully. Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-41a21aaf-3567-46fe-b57d-bce3e773b97b-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-41a21aaf-3567-46fe-b57d-bce3e773b97b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-quobyte-41a21aaf-3567-46fe-b57d-bce3e773b97b" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-41a21aaf-3567-46fe-b57d-bce3e773b97b" acquired by "delete_volume" :: waited 0.048s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bbcd1-97cb-4722-b6b1-9f5b0717c6e5]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:27 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b Nov 01 09:03:27 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:27 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:27 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b Nov 01 09:03:27 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:28 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-41a21aaf-3567-46fe-b57d-bce3e773b97b" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-41a21aaf-3567-46fe-b57d-bce3e773b97b" released by "delete_volume" :: held 0.777s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Created reservations ['80c4c7e8-4206-42d8-af3f-1dfbe3b4674a', 'f3ab76de-55b4-42ac-95a5-99aa0ee8eb58', '46b2efbe-bd5d-4b2a-bc41-4f5a09ea5d19', 'c627cc87-a537-4a39-b28b-ee669b817ed4'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:28 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:28 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-19a68a30-1c72-4305-bf34-0736e3de7327-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-19a68a30-1c72-4305-bf34-0736e3de7327-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-quobyte-19a68a30-1c72-4305-bf34-0736e3de7327" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-19a68a30-1c72-4305-bf34-0736e3de7327" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:28 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.638s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Deleted volume successfully. Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa31926c-c8b8-40d6-adcd-63841589c450]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:29 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-43bb2e52-5e54-44c2-8eab-b3d66696e4ae tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-41a21aaf-3567-46fe-b57d-bce3e773b97b-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:29 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 Nov 01 09:03:29 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:29 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327" returned: 0 in 0.590s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:29 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327 Nov 01 09:03:29 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:29 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-19a68a30-1c72-4305-bf34-0736e3de7327" returned: 0 in 0.340s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:29 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-19a68a30-1c72-4305-bf34-0736e3de7327" released by "delete_volume" :: held 1.025s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Created reservations ['b95b7896-a34f-408f-ab08-9f77348c5adf', 'b0f9778d-92dc-4be4-8da3-f2a5d209d3cb', '2a885bab-8c71-4946-aebb-0afdce378520', '7319b2cf-faad-41f9-adcf-7d66a10bc982'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:30 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:30 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:30 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.492s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Deleted volume successfully. Nov 01 09:03:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-646ca3ad-8dd9-4d44-a0cc-2c23ffb12d32 tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-19a68a30-1c72-4305-bf34-0736e3de7327-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-5c3e4fb5-f843-47bd-ae07-b89beb184c3c-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-5c3e4fb5-f843-47bd-ae07-b89beb184c3c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-quobyte-5c3e4fb5-f843-47bd-ae07-b89beb184c3c" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-5c3e4fb5-f843-47bd-ae07-b89beb184c3c" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:31 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[46898d85-d548-4133-b2eb-e7157aab8648]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:31 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c Nov 01 09:03:31 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:32 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c" returned: 0 in 0.621s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:32 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c Nov 01 09:03:32 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:32 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5c3e4fb5-f843-47bd-ae07-b89beb184c3c" returned: 0 in 0.296s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-5c3e4fb5-f843-47bd-ae07-b89beb184c3c" released by "delete_volume" :: held 1.066s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Created reservations ['f6fd257d-fd67-4d44-9ace-83849c9d9689', '9be96b0d-25cd-4e1c-8907-14d629c76289', '0cd240b9-9726-4e34-99fa-20bd822bb8e0', '117adee2-2d66-4f44-a692-e4b8db303929'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:32 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:32 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:32 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Deleted volume successfully. Nov 01 09:03:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19afc08a-89bf-4565-8288-6e31026f92eb tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-5c3e4fb5-f843-47bd-ae07-b89beb184c3c-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-1445b544-51ee-47e8-86b4-783b99532fe6-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-1445b544-51ee-47e8-86b4-783b99532fe6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-quobyte-1445b544-51ee-47e8-86b4-783b99532fe6" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-1445b544-51ee-47e8-86b4-783b99532fe6" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7a4d9-6cf8-4f1b-9cf1-2eae62745cb9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:33 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 Nov 01 09:03:33 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:34 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6" returned: 0 in 0.443s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:34 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6 Nov 01 09:03:34 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:34 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1445b544-51ee-47e8-86b4-783b99532fe6" returned: 0 in 0.314s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-1445b544-51ee-47e8-86b4-783b99532fe6" released by "delete_volume" :: held 0.830s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Created reservations ['caf2eea4-eb3a-4576-ac0c-29f2835fe185', 'ca81547e-46c6-4426-a030-a987faf507c1', 'cfbba913-b5ca-4da2-b235-ad75de68444a', '159869ed-3a93-4b26-a866-e317fcba5eb3'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:34 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:34 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-70adf1df-dcd8-4bc7-9253-9ef958c08f69-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-70adf1df-dcd8-4bc7-9253-9ef958c08f69-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:34 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Flow 'volume_create_manager' (c424992a-4d5f-4e5d-b6a8-bb86dd372566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0c367b-2d71-429f-b6a8-71010b71c517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0c367b-2d71-429f-b6a8-71010b71c517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-450067307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd2f9c-7459-4de3-806b-d851ae6f0fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2448c9fe52a14fa5822774aa6d93467b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:35Z,use_quota=True,user_id='4bdb87ef03ac47d89810adfd5a8615a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985b9ee7-ba89-44ee-ae91-3f8d655f1c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985b9ee7-ba89-44ee-ae91-3f8d655f1c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50206905-7b3e-4325-bb1d-262681d34b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50206905-7b3e-4325-bb1d-262681d34b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffd2f9c-7459-4de3-806b-d851ae6f0fcb', 'volume_name': 'volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fac299-0380-496e-b6b1-787f89dd97d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fac299-0380-496e-b6b1-787f89dd97d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ddc87f-ea6e-40b0-9fe5-fff65a3a00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Volume dffd2f9c-7459-4de3-806b-d851ae6f0fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb', 'volume_size': 1} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-450067307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffd2f9c-7459-4de3-806b-d851ae6f0fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2448c9fe52a14fa5822774aa6d93467b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:35Z,use_quota=True,user_id='4bdb87ef03ac47d89810adfd5a8615a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Creating volume dffd2f9c-7459-4de3-806b-d851ae6f0fcb {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:35 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:35 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb 1073741824 Nov 01 09:03:35 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "cinder-quobyte-70adf1df-dcd8-4bc7-9253-9ef958c08f69" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-70adf1df-dcd8-4bc7-9253-9ef958c08f69" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[999ae0fc-a333-4bd3-ba05-5d12a84f01e4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:35 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.672s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Deleted volume successfully. Nov 01 09:03:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cb769080-03f1-4466-9d04-89cfcfbd865d tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-1445b544-51ee-47e8-86b4-783b99532fe6-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:35 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 Nov 01 09:03:35 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:36 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69" returned: 0 in 0.566s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:36 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb 1073741824" returned: 0 in 0.736s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:36 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69 Nov 01 09:03:36 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:36 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb Nov 01 09:03:36 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:36 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb" returned: 0 in 0.348s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ddc87f-ea6e-40b0-9fe5-fff65a3a00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7ae918-ad16-4d3d-bf76-bf095fdc7cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:36 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-70adf1df-dcd8-4bc7-9253-9ef958c08f69" returned: 0 in 0.452s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-quobyte-70adf1df-dcd8-4bc7-9253-9ef958c08f69" released by "delete_volume" :: held 1.102s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Volume volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb (dffd2f9c-7459-4de3-806b-d851ae6f0fcb): created successfully Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7ae918-ad16-4d3d-bf76-bf095fdc7cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Flow 'volume_create_manager' (c424992a-4d5f-4e5d-b6a8-bb86dd372566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b2eae65b-0fd6-4b04-a9b7-06a1e7f5c44f tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Created volume successfully. Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Created reservations ['4aeba046-c264-496a-a5d8-02e751f27573', '27c83fd3-52ba-4fd3-9af0-7696e8e76741', 'ec0e3dd8-f4d6-460b-b00b-9b186e26a77e', '882fe6ce-fca0-4cca-8aeb-23e637785a00'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:36 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:36 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:36 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.279s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:36 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Deleted volume successfully. Nov 01 09:03:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2c8a5fae-b042-4d2f-843a-2a650e485ebd tempest-CreateVolumesFromImageTest-2061596013 None] Lock "cinder-70adf1df-dcd8-4bc7-9253-9ef958c08f69-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-8bd11493-daa3-4b35-ae54-aa90d6dbc12b req-fb54e34f-f8df-424b-9386-80358c2f6a71 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-8bd11493-daa3-4b35-ae54-aa90d6dbc12b req-fb54e34f-f8df-424b-9386-80358c2f6a71 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-8bd11493-daa3-4b35-ae54-aa90d6dbc12b req-fb54e34f-f8df-424b-9386-80358c2f6a71 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-8bd11493-daa3-4b35-ae54-aa90d6dbc12b req-fb54e34f-f8df-424b-9386-80358c2f6a71 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad8c0695-ca5e-48a5-8987-79360518a716', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:03:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-8bd11493-daa3-4b35-ae54-aa90d6dbc12b req-fb54e34f-f8df-424b-9386-80358c2f6a71 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] attachment_update completed successfully. Nov 01 09:03:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-ff776388-c5bc-4720-817b-ab88f7d4ad8e req-3c9098ec-89d4-49ef-8149-8276fc5bbf36 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Terminate volume connection completed successfully. Nov 01 09:03:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-ff776388-c5bc-4720-817b-ab88f7d4ad8e req-3c9098ec-89d4-49ef-8149-8276fc5bbf36 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Deleting attachment ad8c0695-ca5e-48a5-8987-79360518a716. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Acquiring lock "cinder-dffd2f9c-7459-4de3-806b-d851ae6f0fcb-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "cinder-dffd2f9c-7459-4de3-806b-d851ae6f0fcb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=79,cinder:UPDATE=87,cinder:INSERT=23,cinder:DELETE=11 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=108,cinder:SELECT=73,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Acquiring lock "cinder-quobyte-dffd2f9c-7459-4de3-806b-d851ae6f0fcb" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "cinder-quobyte-dffd2f9c-7459-4de3-806b-d851ae6f0fcb" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2db6f9-ffa2-4dc7-bc10-ebc3baff67d8]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:42 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb Nov 01 09:03:42 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:43 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb" returned: 0 in 0.385s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:43 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb Nov 01 09:03:43 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:43 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-dffd2f9c-7459-4de3-806b-d851ae6f0fcb" returned: 0 in 0.269s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "cinder-quobyte-dffd2f9c-7459-4de3-806b-d851ae6f0fcb" released by "delete_volume" :: held 0.698s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Created reservations ['5d143690-ec92-42b6-8669-9f391f8710d7', 'a15bd54d-913a-48d9-a7ed-3935b522af9a', 'e1254f47-30f0-4ab6-b91b-c13ba4bdd9e5', '75f73551-336e-43ae-97d9-c7a5fd723a1f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:43 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:43 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:43 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.269s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Deleted volume successfully. Nov 01 09:03:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f1b14ab-bc4f-46b9-9d57-63196f27d685 tempest-TestServerVolumeAttachScenarioOldVersion-1856137562 None] Lock "cinder-dffd2f9c-7459-4de3-806b-d851ae6f0fcb-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Flow 'volume_create_manager' (97960f34-3aaa-49d3-9278-18b33df2ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1136d609-cefe-4df3-97df-5d90ec01624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1136d609-cefe-4df3-97df-5d90ec01624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a4266c-a58f-4d94-a71d-119ce03d5af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0136a19c6f4a9e998771f50af92e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:44Z,use_quota=True,user_id='b9309ad3a35a42d9a44ba5a0ec508ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d10e5cd-ffd1-4f52-9529-87b312479d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d10e5cd-ffd1-4f52-9529-87b312479d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccbd2c9-4a8a-45d3-bdc7-918bc6c1f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fccbd2c9-4a8a-45d3-bdc7-918bc6c1f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07a4266c-a58f-4d94-a71d-119ce03d5af2', 'volume_name': 'volume-07a4266c-a58f-4d94-a71d-119ce03d5af2', 'volume_size': 1, 'image_id': '415f7881-e704-4745-a625-f4e979f22c4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/415f7881-e704-4745-a625-f4e979f22c4d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56e73d8207e2c16a4d1a5eaf6e18e1f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c0136a19c6f4a9e998771f50af92e72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62c73d266381bb1ed1b3dfe69ca238db65b448fa69a5780658351810dee24b36aa5c90251c75dde4e1cef77a994542f184d35d3afadec18649ac4c0dfa5a1df3', 'id': '415f7881-e704-4745-a625-f4e979f22c4d', 'created_at': datetime.datetime(2026, 11, 1, 8, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 3, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/415f7881-e704-4745-a625-f4e979f22c4d/file', 'properties': {}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630e1b95-cbed-46ee-9a11-aed761bb3a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630e1b95-cbed-46ee-9a11-aed761bb3a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75501c8a-c324-4129-9260-7d63680724ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:44 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Volume 07a4266c-a58f-4d94-a71d-119ce03d5af2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07a4266c-a58f-4d94-a71d-119ce03d5af2', 'volume_size': 1, 'image_id': '415f7881-e704-4745-a625-f4e979f22c4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/415f7881-e704-4745-a625-f4e979f22c4d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56e73d8207e2c16a4d1a5eaf6e18e1f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c0136a19c6f4a9e998771f50af92e72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62c73d266381bb1ed1b3dfe69ca238db65b448fa69a5780658351810dee24b36aa5c90251c75dde4e1cef77a994542f184d35d3afadec18649ac4c0dfa5a1df3', 'id': '415f7881-e704-4745-a625-f4e979f22c4d', 'created_at': datetime.datetime(2026, 11, 1, 8, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 3, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/415f7881-e704-4745-a625-f4e979f22c4d/file', 'properties': {}}, 'image_service': } Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Trying to clone 07a4266c-a58f-4d94-a71d-119ce03d5af2 from image 415f7881-e704-4745-a625-f4e979f22c4d at location (None, [{'url': 'file:///opt/stack/data/glance/images/415f7881-e704-4745-a625-f4e979f22c4d', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:03:44 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61a955-eccf-4a92-a3d2-e35e855be6a1]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:44 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD Nov 01 09:03:44 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:45 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:45 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD Nov 01 09:03:45 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:45 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Temporary image 415f7881-e704-4745-a625-f4e979f22c4d is fetched for user b9309ad3a35a42d9a44ba5a0ec508ac9. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b661a0cd-b1c3-49be-803a-edeb27e7cb81]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:45 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD Nov 01 09:03:45 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:45 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:46 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD Nov 01 09:03:46 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:46 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD" returned: 1 in 0.339s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a4266c-a58f-4d94-a71d-119ce03d5af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0136a19c6f4a9e998771f50af92e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:44Z,use_quota=True,user_id='b9309ad3a35a42d9a44ba5a0ec508ac9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Creating volume 07a4266c-a58f-4d94-a71d-119ce03d5af2 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:46 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:46 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 1073741824 Nov 01 09:03:46 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:46 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 1073741824" returned: 0 in 0.470s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:46 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 Nov 01 09:03:46 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:47 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2" returned: 0 in 0.268s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Attempting download of 415f7881-e704-4745-a625-f4e979f22c4d ((None, [{'url': 'file:///opt/stack/data/glance/images/415f7881-e704-4745-a625-f4e979f22c4d', 'metadata': {}}])) to volume 07a4266c-a58f-4d94-a71d-119ce03d5af2. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7ae400-53e6-4bd5-881e-1587ec0d4a57]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_415f7881-e704-4745-a625-f4e979f22c4d_uqzklqvt {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:47 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_415f7881-e704-4745-a625-f4e979f22c4d_uqzklqvt Nov 01 09:03:47 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:47 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_415f7881-e704-4745-a625-f4e979f22c4d_uqzklqvt" returned: 0 in 0.406s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_415f7881-e704-4745-a625-f4e979f22c4d_uqzklqvt {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:47 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_415f7881-e704-4745-a625-f4e979f22c4d_uqzklqvt Nov 01 09:03:47 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:47 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_415f7881-e704-4745-a625-f4e979f22c4d_uqzklqvt" returned: 1 in 0.341s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_415f7881-e704-4745-a625-f4e979f22c4d_uqzklqvt' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9fc04e-3d7c-4c1e-99c7-50869024d74c]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:48 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD Nov 01 09:03:48 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:48 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:48 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD Nov 01 09:03:48 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:48 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:03:48 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] 415f7881-e704-4745-a625-f4e979f22c4d was raw, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:03:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:48 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 Nov 01 09:03:48 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:49 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2" returned: 0 in 0.462s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_415f7881-e704-4745-a625-f4e979f22c4d_nm_wkgm2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:03:49 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:49 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 1G Nov 01 09:03:49 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:49 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 1G" returned: 0 in 0.345s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Downloaded image 415f7881-e704-4745-a625-f4e979f22c4d ((None, [{'url': 'file:///opt/stack/data/glance/images/415f7881-e704-4745-a625-f4e979f22c4d', 'metadata': {}}])) to volume 07a4266c-a58f-4d94-a71d-119ce03d5af2 successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Temporary image 415f7881-e704-4745-a625-f4e979f22c4d for user b9309ad3a35a42d9a44ba5a0ec508ac9 is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Marking volume 07a4266c-a58f-4d94-a71d-119ce03d5af2 as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Copying metadata from image 415f7881-e704-4745-a625-f4e979f22c4d to 07a4266c-a58f-4d94-a71d-119ce03d5af2. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Creating volume glance metadata for volume 07a4266c-a58f-4d94-a71d-119ce03d5af2 backed by image 415f7881-e704-4745-a625-f4e979f22c4d with: {'image_id': '415f7881-e704-4745-a625-f4e979f22c4d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '56e73d8207e2c16a4d1a5eaf6e18e1f1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75501c8a-c324-4129-9260-7d63680724ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a4266c-a58f-4d94-a71d-119ce03d5af2', 'volume_size': 1, 'image_id': '415f7881-e704-4745-a625-f4e979f22c4d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/415f7881-e704-4745-a625-f4e979f22c4d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56e73d8207e2c16a4d1a5eaf6e18e1f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c0136a19c6f4a9e998771f50af92e72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62c73d266381bb1ed1b3dfe69ca238db65b448fa69a5780658351810dee24b36aa5c90251c75dde4e1cef77a994542f184d35d3afadec18649ac4c0dfa5a1df3', 'id': '415f7881-e704-4745-a625-f4e979f22c4d', 'created_at': datetime.datetime(2026, 11, 1, 8, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 3, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/415f7881-e704-4745-a625-f4e979f22c4d/file', 'properties': {}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78038c2a-85c4-4219-9177-2e9ee66d7618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Volume volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 (07a4266c-a58f-4d94-a71d-119ce03d5af2): created successfully Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78038c2a-85c4-4219-9177-2e9ee66d7618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Flow 'volume_create_manager' (97960f34-3aaa-49d3-9278-18b33df2ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5fdd2ae5-3520-4a18-8dca-49eb0a3ce650 tempest-VolumeImageDependencyTests-907620015 None] Created volume successfully. Nov 01 09:03:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Acquiring lock "cinder-07a4266c-a58f-4d94-a71d-119ce03d5af2-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Lock "cinder-07a4266c-a58f-4d94-a71d-119ce03d5af2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Acquiring lock "cinder-quobyte-07a4266c-a58f-4d94-a71d-119ce03d5af2" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:03:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Lock "cinder-quobyte-07a4266c-a58f-4d94-a71d-119ce03d5af2" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:03:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687b319-2002-4e2a-a12a-37e980a98857]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:03:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:50 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 Nov 01 09:03:50 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:51 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Flow 'volume_create_manager' (95d90716-e972-4ac1-9cb9-28a8a5062c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6de429-e2fa-44a9-8c29-01becf65e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2" returned: 0 in 0.552s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:51 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2 Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6de429-e2fa-44a9-8c29-01becf65e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1552911374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e072e2-0420-4b03-97f9-b307e94dee66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93928bb7d8a348e1af0abaa03416b32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:51Z,use_quota=True,user_id='53862af1b1ee4713aceb00b1301a14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:51 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e396ad60-8ed2-4199-b340-0eed4541a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e396ad60-8ed2-4199-b340-0eed4541a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d291cec-6d09-4b29-9f4b-8a15faca5aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d291cec-6d09-4b29-9f4b-8a15faca5aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e072e2-0420-4b03-97f9-b307e94dee66', 'volume_name': 'volume-91e072e2-0420-4b03-97f9-b307e94dee66', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928695ac-e623-40da-a8c8-01eb2f945a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928695ac-e623-40da-a8c8-01eb2f945a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f002cbaf-7316-4546-8f2b-4e8076c8a8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:51 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Volume 91e072e2-0420-4b03-97f9-b307e94dee66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e072e2-0420-4b03-97f9-b307e94dee66', 'volume_size': 1} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1552911374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e072e2-0420-4b03-97f9-b307e94dee66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93928bb7d8a348e1af0abaa03416b32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:03:51Z,use_quota=True,user_id='53862af1b1ee4713aceb00b1301a14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Creating volume 91e072e2-0420-4b03-97f9-b307e94dee66 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:03:51 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:51 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 1073741824 Nov 01 09:03:51 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:51 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-07a4266c-a58f-4d94-a71d-119ce03d5af2" returned: 0 in 0.322s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Lock "cinder-quobyte-07a4266c-a58f-4d94-a71d-119ce03d5af2" released by "delete_volume" :: held 0.928s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Created reservations ['f4163cb9-2e57-4ad8-b10f-243f3e2a22d0', 'a5b9393c-30cc-496a-a247-afbaf2e9cbdd', '39721303-766b-4e1a-b1b3-9e1e21534456', '0124d310-2527-4c7c-8da7-c796c1a6a254'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:51 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:03:51 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:52 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 1073741824" returned: 0 in 0.676s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:03:52 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 Nov 01 09:03:52 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:03:52 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.425s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:03:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Deleted volume successfully. Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-88ef5948-bb72-4b90-bee3-9d644093c230 tempest-VolumeImageDependencyTests-907620015 None] Lock "cinder-07a4266c-a58f-4d94-a71d-119ce03d5af2-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:03:52 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66" returned: 0 in 0.360s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f002cbaf-7316-4546-8f2b-4e8076c8a8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e072e2-0420-4b03-97f9-b307e94dee66', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72af3596-0533-473f-b193-dcd977f58c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:03:52 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Volume volume-91e072e2-0420-4b03-97f9-b307e94dee66 (91e072e2-0420-4b03-97f9-b307e94dee66): created successfully Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72af3596-0533-473f-b193-dcd977f58c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:03:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Flow 'volume_create_manager' (95d90716-e972-4ac1-9cb9-28a8a5062c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:03:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-620800ae-8e88-479e-8d0a-ca3e80011474 tempest-AttachVolumeNegativeTest-572358819 None] Created volume successfully. Nov 01 09:03:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2c00e3d7-eeea-4523-94a9-8895421cee75 req-4ceafd5b-c0bf-494f-bc11-9e456a847765 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:03:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2c00e3d7-eeea-4523-94a9-8895421cee75 req-4ceafd5b-c0bf-494f-bc11-9e456a847765 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:03:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2c00e3d7-eeea-4523-94a9-8895421cee75 req-4ceafd5b-c0bf-494f-bc11-9e456a847765 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:03:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2c00e3d7-eeea-4523-94a9-8895421cee75 req-4ceafd5b-c0bf-494f-bc11-9e456a847765 tempest-AttachVolumeNegativeTest-572358819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-91e072e2-0420-4b03-97f9-b307e94dee66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca963d3c-0fb4-490a-8578-c485df11df22', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:03:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-2c00e3d7-eeea-4523-94a9-8895421cee75 req-4ceafd5b-c0bf-494f-bc11-9e456a847765 tempest-AttachVolumeNegativeTest-572358819 None] attachment_update completed successfully. Nov 01 09:03:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-7eebb7b5-d003-4008-9a19-daec3a3d19db req-144a20e1-2791-4ed1-8c1c-40cd05680059 tempest-AttachVolumeNegativeTest-572358819 None] Terminate volume connection completed successfully. Nov 01 09:03:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7eebb7b5-d003-4008-9a19-daec3a3d19db req-144a20e1-2791-4ed1-8c1c-40cd05680059 tempest-AttachVolumeNegativeTest-572358819 None] Deleting attachment ca963d3c-0fb4-490a-8578-c485df11df22. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (31d9e523-97ad-40e8-a1fe-f194d036c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b99d92a-f30e-4aee-96f5-65de3cbde238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b99d92a-f30e-4aee-96f5-65de3cbde238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1314658497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7ab27a-58c4-4d88-8de8-3cf0da9032a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:02Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06256e71-0ec8-4510-92ab-ffafff89e3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06256e71-0ec8-4510-92ab-ffafff89e3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4be94b2-fa31-4802-888d-410e035cf5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4be94b2-fa31-4802-888d-410e035cf5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7ab27a-58c4-4d88-8de8-3cf0da9032a7', 'volume_name': 'volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16af12b2-09e8-4874-9d0a-032d13a14bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16af12b2-09e8-4874-9d0a-032d13a14bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f809f1-76fb-4816-afd0-13dc34d4cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:02 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume ac7ab27a-58c4-4d88-8de8-3cf0da9032a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7', 'volume_size': 1} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1314658497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7ab27a-58c4-4d88-8de8-3cf0da9032a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:02Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Creating volume ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:02 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:02 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 1073741824 Nov 01 09:04:02 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:02 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 1073741824" returned: 0 in 0.510s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:02 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 Nov 01 09:04:02 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:03 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7" returned: 0 in 0.315s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f809f1-76fb-4816-afd0-13dc34d4cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0780e3c1-dd7b-46a1-92e9-7d249f8aa66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:03 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 (ac7ab27a-58c4-4d88-8de8-3cf0da9032a7): created successfully Nov 01 09:04:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0780e3c1-dd7b-46a1-92e9-7d249f8aa66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (31d9e523-97ad-40e8-a1fe-f194d036c614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fc4a2324-d5b0-4d19-ac0f-3e59af6951e4 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created volume successfully. Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (036ad8ae-b558-498c-b05c-019697f4dbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449281d2-a1f1-424e-85ab-e2170ce30946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449281d2-a1f1-424e-85ab-e2170ce30946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519318779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:05Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d511c30a-ba08-4ef0-b417-de9b0b4c5ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d511c30a-ba08-4ef0-b417-de9b0b4c5ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c8da5-5822-4eba-a1a0-116ac2aa8328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c8da5-5822-4eba-a1a0-116ac2aa8328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b', 'volume_name': 'volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446ab891-aaaf-4414-adf0-1a506ce19f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446ab891-aaaf-4414-adf0-1a506ce19f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773e5986-1de5-4aa1-860b-a82c997f5e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:04 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume 3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b', 'volume_size': 1} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519318779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:05Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Creating volume 3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:04 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:04 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b 1073741824 Nov 01 09:04:04 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (dfd7aaf2-bfa6-4e80-a9c8-aaca6326f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907f20dc-47c2-4281-bd89-45f8051795a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907f20dc-47c2-4281-bd89-45f8051795a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992468540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db8d9d4-2623-424e-a9ed-9e3d1c413eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:05Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1582c9c0-1ed6-4661-b5ba-4faacd445adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1582c9c0-1ed6-4661-b5ba-4faacd445adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8709493c-eb61-4efa-8856-8d09feac0b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8709493c-eb61-4efa-8856-8d09feac0b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db8d9d4-2623-424e-a9ed-9e3d1c413eff', 'volume_name': 'volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557a4bc3-2d02-4f77-ae38-9c1f58d6ec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557a4bc3-2d02-4f77-ae38-9c1f58d6ec5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76eaeb22-7249-4238-8ce3-450e35a064fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume 0db8d9d4-2623-424e-a9ed-9e3d1c413eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff', 'volume_size': 1} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:05 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b 1073741824" returned: 0 in 0.649s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:05 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b Nov 01 09:04:05 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (07427493-e496-42de-9a6c-9b3037acf85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c768a902-8568-42fa-af09-e4676ce09b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c768a902-8568-42fa-af09-e4676ce09b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574371152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b724f2e-4881-41bd-93e9-23d91ef50316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:06Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c07662-da8d-4692-ad2e-bf36c5b86486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c07662-da8d-4692-ad2e-bf36c5b86486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ff7c7-3272-46c0-8b9e-2b07b29a6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38ff7c7-3272-46c0-8b9e-2b07b29a6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b724f2e-4881-41bd-93e9-23d91ef50316', 'volume_name': 'volume-9b724f2e-4881-41bd-93e9-23d91ef50316', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cbe9d3-fb1d-4d0e-b8d0-c00fc6ad761f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60cbe9d3-fb1d-4d0e-b8d0-c00fc6ad761f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ddd556-5acf-49d1-86e5-863339eea840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume 9b724f2e-4881-41bd-93e9-23d91ef50316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b724f2e-4881-41bd-93e9-23d91ef50316', 'volume_size': 1} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:05 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b" returned: 0 in 0.338s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992468540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db8d9d4-2623-424e-a9ed-9e3d1c413eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:05Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Creating volume 0db8d9d4-2623-424e-a9ed-9e3d1c413eff {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:05 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:05 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff 1073741824 Nov 01 09:04:05 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773e5986-1de5-4aa1-860b-a82c997f5e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f99a40-4278-4c03-a9c5-35eabf77f028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b (3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b): created successfully Nov 01 09:04:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f99a40-4278-4c03-a9c5-35eabf77f028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (036ad8ae-b558-498c-b05c-019697f4dbff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-af1289d9-7023-48c3-9759-aaf3f42a9705 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created volume successfully. Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (16458e03-d25f-4087-95a2-90e0b01db5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbadae02-e781-4f63-b9f0-d34e19f06bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbadae02-e781-4f63-b9f0-d34e19f06bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779343433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50662bd4-6839-499b-976c-c847d6f47acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:06Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000fc82b-b2a2-4518-8830-c4a59e894ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000fc82b-b2a2-4518-8830-c4a59e894ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3f92c8-0cc5-4e81-9e61-0963a93a45cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3f92c8-0cc5-4e81-9e61-0963a93a45cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50662bd4-6839-499b-976c-c847d6f47acf', 'volume_name': 'volume-50662bd4-6839-499b-976c-c847d6f47acf', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4494867-2075-41b0-9905-0da6212fbc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4494867-2075-41b0-9905-0da6212fbc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9e55ff-5508-485a-9e80-9380b092bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume 50662bd4-6839-499b-976c-c847d6f47acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50662bd4-6839-499b-976c-c847d6f47acf', 'volume_size': 1} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (413f85bc-2862-4807-ad35-f3526cf49fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0368e3fb-3e72-4eac-b6ed-7daf2c22a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0368e3fb-3e72-4eac-b6ed-7daf2c22a3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135044795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:06Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcebe28-9889-4ff8-a22c-64693fb4937d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcebe28-9889-4ff8-a22c-64693fb4937d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7199fe3-9419-4dcd-bf2d-a9328ef765f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7199fe3-9419-4dcd-bf2d-a9328ef765f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd', 'volume_name': 'volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542d691b-cf85-4bda-949e-471391247c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542d691b-cf85-4bda-949e-471391247c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e5305e-19f3-41fc-ad2a-4b1821b5d65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd', 'volume_size': 1} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff 1073741824" returned: 0 in 0.638s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:06 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff Nov 01 09:04:06 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:06 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff" returned: 0 in 0.278s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.119s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574371152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b724f2e-4881-41bd-93e9-23d91ef50316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:06Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Creating volume 9b724f2e-4881-41bd-93e9-23d91ef50316 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:06 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76eaeb22-7249-4238-8ce3-450e35a064fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a315c29a-f92e-456a-834a-fc4e8c5f4be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:06 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 1073741824 Nov 01 09:04:06 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:06 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff (0db8d9d4-2623-424e-a9ed-9e3d1c413eff): created successfully Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a315c29a-f92e-456a-834a-fc4e8c5f4be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (dfd7aaf2-bfa6-4e80-a9c8-aaca6326f172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-914c9c42-3e6b-47f1-89c4-e479ac37f05a tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created volume successfully. Nov 01 09:04:07 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 1073741824" returned: 0 in 0.516s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:07 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 Nov 01 09:04:07 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:07 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316" returned: 0 in 0.314s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779343433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50662bd4-6839-499b-976c-c847d6f47acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:06Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Creating volume 50662bd4-6839-499b-976c-c847d6f47acf {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:07 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ddd556-5acf-49d1-86e5-863339eea840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b724f2e-4881-41bd-93e9-23d91ef50316', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:07 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf 1073741824 Nov 01 09:04:07 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e49886-6113-4d6f-8c4f-c79a588cfd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:07 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume volume-9b724f2e-4881-41bd-93e9-23d91ef50316 (9b724f2e-4881-41bd-93e9-23d91ef50316): created successfully Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e49886-6113-4d6f-8c4f-c79a588cfd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (07427493-e496-42de-9a6c-9b3037acf85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-249ebdf5-3fef-4fdf-9f82-573e0f3c5371 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created volume successfully. Nov 01 09:04:08 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf 1073741824" returned: 0 in 0.564s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:08 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf Nov 01 09:04:08 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:08 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135044795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40207baa813e4a5bbdcaee6911591476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:06Z,use_quota=True,user_id='6be896b6d0564800a73458fcd2799e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Creating volume bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:08 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:08 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd 1073741824 Nov 01 09:04:08 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9e55ff-5508-485a-9e80-9380b092bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50662bd4-6839-499b-976c-c847d6f47acf', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a0b481-d64e-4850-94b8-2bde5c03ca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:08 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume volume-50662bd4-6839-499b-976c-c847d6f47acf (50662bd4-6839-499b-976c-c847d6f47acf): created successfully Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a0b481-d64e-4850-94b8-2bde5c03ca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (16458e03-d25f-4087-95a2-90e0b01db5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5bbd4c6b-3d02-4373-b432-3203b344794c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created volume successfully. Nov 01 09:04:09 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd 1073741824" returned: 0 in 0.530s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:09 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd Nov 01 09:04:09 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:09 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd" returned: 0 in 0.272s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e5305e-19f3-41fc-ad2a-4b1821b5d65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacb1aed-685d-43d5-b6e2-c51466780bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:09 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Volume volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd (bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd): created successfully Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacb1aed-685d-43d5-b6e2-c51466780bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Flow 'volume_create_manager' (413f85bc-2862-4807-ad35-f3526cf49fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d166713c-42f5-4704-976f-2bc7bf9a6ebc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created volume successfully. Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-quobyte-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d4bcf7-3efb-4337-8bb2-71c3f2e57efb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:10 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd Nov 01 09:04:10 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:10 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd" returned: 0 in 0.406s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:10 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd Nov 01 09:04:10 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:10 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd" returned: 0 in 0.433s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd" released by "delete_volume" :: held 0.896s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created reservations ['e41e2175-34a4-4c03-94ef-acb8330cd90f', '40ce493e-4b01-4cff-a23e-1ca668903dfb', '192af9f1-ed3f-4e09-849e-4bc5056efb5f', '907e7c97-860a-4a95-a917-d98f70d597dc'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:11 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:11 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-50662bd4-6839-499b-976c-c847d6f47acf-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-50662bd4-6839-499b-976c-c847d6f47acf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-quobyte-50662bd4-6839-499b-976c-c847d6f47acf" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-50662bd4-6839-499b-976c-c847d6f47acf" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87656b2-e890-4e2c-bc2c-3ecdd346161a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:11 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf Nov 01 09:04:11 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:11 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.669s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Deleted volume successfully. Nov 01 09:04:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ec80a2ae-7f08-4474-a115-ea37f39828e5 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-bcdc64d2-77b3-4f0a-a7bb-c9ebf473a0dd-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:12 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf" returned: 0 in 0.571s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:12 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf Nov 01 09:04:12 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:12 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-50662bd4-6839-499b-976c-c847d6f47acf" returned: 0 in 0.293s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-50662bd4-6839-499b-976c-c847d6f47acf" released by "delete_volume" :: held 0.993s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created reservations ['ca4a8354-7d60-4d06-9d1b-624291fce8fd', 'b5741843-f9c7-4248-aca0-5259f2a17514', '779e9c59-6869-44ec-96f5-a819f334a054', '873c3c16-9362-4133-bdba-981644a533a0'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:12 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:12 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-9b724f2e-4881-41bd-93e9-23d91ef50316-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-9b724f2e-4881-41bd-93e9-23d91ef50316-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-quobyte-9b724f2e-4881-41bd-93e9-23d91ef50316" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-9b724f2e-4881-41bd-93e9-23d91ef50316" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7417a00-cda1-4703-b4fb-e637bb5c0e15]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:12 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.311s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:12 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Deleted volume successfully. Nov 01 09:04:12 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 Nov 01 09:04:12 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5e219265-4315-4035-addb-033f2cf67db0 tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-50662bd4-6839-499b-976c-c847d6f47acf-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:13 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316" returned: 0 in 0.443s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:13 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316 Nov 01 09:04:13 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:13 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9b724f2e-4881-41bd-93e9-23d91ef50316" returned: 0 in 0.292s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-9b724f2e-4881-41bd-93e9-23d91ef50316" released by "delete_volume" :: held 0.786s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created reservations ['afaa6ef7-5f43-47a4-8450-3d333c6e68c9', '2280907d-b67e-4072-a56c-11d1c8d1cf31', 'cc4dd77c-6684-43e0-8f19-8e520a8e4afa', 'e00fca7f-8cf9-4b2c-9ac2-e7bc1e4cb6a3'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:13 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:13 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-0db8d9d4-2623-424e-a9ed-9e3d1c413eff-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-0db8d9d4-2623-424e-a9ed-9e3d1c413eff-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-quobyte-0db8d9d4-2623-424e-a9ed-9e3d1c413eff" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-0db8d9d4-2623-424e-a9ed-9e3d1c413eff" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:14 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.365s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:14 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Deleted volume successfully. Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[46693a07-cb75-4658-9a16-3c28a7fb0ba2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4f2d811b-5244-4a9d-98cc-ad617459135b tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-9b724f2e-4881-41bd-93e9-23d91ef50316-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:14 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff Nov 01 09:04:14 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:14 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff" returned: 0 in 0.472s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:14 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff Nov 01 09:04:14 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:14 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0db8d9d4-2623-424e-a9ed-9e3d1c413eff" returned: 0 in 0.289s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-0db8d9d4-2623-424e-a9ed-9e3d1c413eff" released by "delete_volume" :: held 0.830s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:14 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created reservations ['c6537f21-c4a9-4f02-b077-22a8663bf9ff', 'c0d6b013-92ad-4404-b54a-6d1f49d30803', 'cb19626b-9b3a-45f3-aa5f-776822b57d2c', '53ceaebe-29a9-48f2-ae94-8478233fbe68'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:15 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:15 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-quobyte-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[512277d0-772b-4dc6-aa05-9008e81ac05f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:15 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Deleted volume successfully. Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-06c7fdf6-a09e-4921-ae8e-3e4f58bf2e9c tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-0db8d9d4-2623-424e-a9ed-9e3d1c413eff-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:15 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b Nov 01 09:04:15 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:15 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b" returned: 0 in 0.466s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:15 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b Nov 01 09:04:15 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:16 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b" returned: 0 in 0.248s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b" released by "delete_volume" :: held 0.786s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created reservations ['0bc4e799-ec8a-44b9-808f-127d48348ae9', 'c9e2e57b-57a2-4af8-8c30-3d710e3d0446', 'b279d54c-7933-4adb-9f87-500c5ef97bc6', '3055473a-7e2f-41a4-af87-e654e5651e0a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:16 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:16 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "cinder-quobyte-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:16 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.337s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:16 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Deleted volume successfully. Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d0fb3-b5ea-44ef-92e9-7884b8844fc8]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f39e5f05-7b7a-4587-8d07-7503d461f18f tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-3b7ffb19-7dd4-46cd-a7e1-9e8a018d3f8b-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:16 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 Nov 01 09:04:16 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:16 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7" returned: 0 in 0.388s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:16 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7 Nov 01 09:04:16 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:17 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7" returned: 0 in 0.270s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-quobyte-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7" released by "delete_volume" :: held 0.717s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Created reservations ['3f54b1b8-8488-4ce9-95be-bcb7ce297b31', '18f17e6f-2765-4cbd-a052-757d7731a1cc', '52838d5b-3999-42ff-b3a0-d3f99d5c51d2', '6e5dfcb7-2191-4e08-85ba-1a10d4d55376'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:17 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:17 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:17 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.278s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Deleted volume successfully. Nov 01 09:04:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ce2ee2e2-ed44-48ed-af3e-a831a81920cc tempest-CreateVolumesFromSourceVolumeTest-523563406 None] Lock "cinder-ac7ab27a-58c4-4d88-8de8-3cf0da9032a7-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Flow 'volume_create_manager' (77ee7d04-a8f8-4fbc-8381-5207ca833836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb41102-bdde-421e-8d4b-2f787c72ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb41102-bdde-421e-8d4b-2f787c72ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-599467392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054d6606-7a28-4024-9443-cfd523ac1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f022e554db144d7b8eb769cca5fc50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:21Z,use_quota=True,user_id='83164535f5614636997b0e790c9a694c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4f647b-5ebe-4cfd-b05f-1538a5feff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4f647b-5ebe-4cfd-b05f-1538a5feff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d1a7f0-1cfd-41dd-b296-48402251038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d1a7f0-1cfd-41dd-b296-48402251038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054d6606-7a28-4024-9443-cfd523ac1685', 'volume_name': 'volume-054d6606-7a28-4024-9443-cfd523ac1685', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0103de2-1e55-455a-a111-aee47ff486a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0103de2-1e55-455a-a111-aee47ff486a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5b8569-4e37-4602-a8a1-81692ac84e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:20 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Volume 054d6606-7a28-4024-9443-cfd523ac1685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054d6606-7a28-4024-9443-cfd523ac1685', 'volume_size': 1} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-599467392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054d6606-7a28-4024-9443-cfd523ac1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f022e554db144d7b8eb769cca5fc50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:21Z,use_quota=True,user_id='83164535f5614636997b0e790c9a694c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Creating volume 054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:20 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:20 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 1073741824 Nov 01 09:04:20 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:21 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 1073741824" returned: 0 in 0.426s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:21 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 Nov 01 09:04:21 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:21 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:21 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:21 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685" returned: 0 in 0.261s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5b8569-4e37-4602-a8a1-81692ac84e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054d6606-7a28-4024-9443-cfd523ac1685', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a3128-28e0-4d79-8531-5f91df1f42db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:21 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Volume volume-054d6606-7a28-4024-9443-cfd523ac1685 (054d6606-7a28-4024-9443-cfd523ac1685): created successfully Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a3128-28e0-4d79-8531-5f91df1f42db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Flow 'volume_create_manager' (77ee7d04-a8f8-4fbc-8381-5207ca833836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:21 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ed7994fe-ef35-4d2b-b1cd-4d0bc418153c tempest-VolumeDependencyTests-664341783 None] Created volume successfully. Nov 01 09:04:21 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Creating offline snapshot 55a7642d-add1-4080-bcb5-95aa8818b15a of volume 054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a71255-ad5a-4ed5-9430-4c802cf246dc]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:22 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 Nov 01 09:04:22 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:22 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685" returned: 0 in 0.375s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:22 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a 1G Nov 01 09:04:22 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:22 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a 1G" returned: 0 in 0.404s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054d6606-7a28-4024-9443-cfd523ac1685 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:22 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054d6606-7a28-4024-9443-cfd523ac1685 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a Nov 01 09:04:22 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:23 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-054d6606-7a28-4024-9443-cfd523ac1685 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a" returned: 0 in 0.296s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:23 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a is being set with open permissions: ugo+rw Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:23 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a Nov 01 09:04:23 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:23 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a" returned: 0 in 0.254s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:23 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.info Nov 01 09:04:23 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:23 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.info" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:23 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.info is being set with open permissions: ugo+rw Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:23 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.info Nov 01 09:04:23 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:23 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.info" returned: 0 in 0.258s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-14114e2b-09f8-423d-a28c-107eb84a93b7 tempest-VolumeDependencyTests-664341783 None] Create snapshot completed successfully Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Flow 'volume_create_manager' (abc8201b-65e3-4ae7-b891-67a70d4e21c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39f0858-e3ac-403f-bedb-771c15a6317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39f0858-e3ac-403f-bedb-771c15a6317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1207371874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7ec0cf-6b1d-4792-bb8a-a452090f007f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f022e554db144d7b8eb769cca5fc50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55a7642d-add1-4080-bcb5-95aa8818b15a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:25Z,use_quota=True,user_id='83164535f5614636997b0e790c9a694c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3102ca5-2054-43e9-8a2a-0c41dfc7a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3102ca5-2054-43e9-8a2a-0c41dfc7a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe342fa-f1d7-4b40-99ce-9ff91ea48104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe342fa-f1d7-4b40-99ce-9ff91ea48104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a7ec0cf-6b1d-4792-bb8a-a452090f007f', 'volume_name': 'volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f', 'volume_size': 1, 'snapshot_id': '55a7642d-add1-4080-bcb5-95aa8818b15a'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cf911c-d501-4453-9aa8-4d94f9dbf757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cf911c-d501-4453-9aa8-4d94f9dbf757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe52ebb-ae83-4948-84a1-23b6b383b656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Volume 7a7ec0cf-6b1d-4792-bb8a-a452090f007f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f', 'volume_size': 1, 'snapshot_id': '55a7642d-add1-4080-bcb5-95aa8818b15a'} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-quobyte-55a7642d-add1-4080-bcb5-95aa8818b15a-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-55a7642d-add1-4080-bcb5-95aa8818b15a-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Creating volume 7a7ec0cf-6b1d-4792-bb8a-a452090f007f from snapshot 55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-quobyte-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] snapshot: 55a7642d-add1-4080-bcb5-95aa8818b15a, volume: 7a7ec0cf-6b1d-4792-bb8a-a452090f007f, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d3b4b-e1b6-4835-86a3-21e19155833e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:24 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a Nov 01 09:04:24 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:25 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a" returned: 0 in 0.353s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-054d6606-7a28-4024-9443-cfd523ac1685(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5479a-a2d7-4b1e-91a0-de80c0ec94e1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:25 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 Nov 01 09:04:25 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:25 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685" returned: 0 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:04:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:25 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f Nov 01 09:04:25 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:31 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" returned: 0 in 5.988s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:04:31 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Converted 1024.00 MB image at 170.97 MB/s Nov 01 09:04:31 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f is being set with open permissions: ugo+rw Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:31 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f Nov 01 09:04:31 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:31 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" released by "_copy_volume_from_snapshot" :: held 7.034s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-55a7642d-add1-4080-bcb5-95aa8818b15a-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" released by "_create_volume_from_snapshot" :: held 7.102s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.117s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe52ebb-ae83-4948-84a1-23b6b383b656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f', 'volume_size': 1, 'snapshot_id': '55a7642d-add1-4080-bcb5-95aa8818b15a'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ea02c6-5455-4e50-8ae7-f1260a75421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Volume volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f (7a7ec0cf-6b1d-4792-bb8a-a452090f007f): created successfully Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ea02c6-5455-4e50-8ae7-f1260a75421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Flow 'volume_create_manager' (abc8201b-65e3-4ae7-b891-67a70d4e21c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4b700e4d-8f5b-4104-a4f4-c72d29bd2fd8 tempest-VolumeDependencyTests-664341783 None] Created volume successfully. Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-55a7642d-add1-4080-bcb5-95aa8818b15a-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-55a7642d-add1-4080-bcb5-95aa8818b15a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-quobyte-054d6606-7a28-4024-9443-cfd523ac1685" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-054d6606-7a28-4024-9443-cfd523ac1685" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-quobyte-55a7642d-add1-4080-bcb5-95aa8818b15a" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-55a7642d-add1-4080-bcb5-95aa8818b15a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Deleting offline snapshot 55a7642d-add1-4080-bcb5-95aa8818b15a of volume 054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] snapshot_file for this snap is: volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf9be37-3782-4453-832b-1d486f3065c6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:32 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a Nov 01 09:04:32 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:32 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a" returned: 0 in 0.351s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-054d6606-7a28-4024-9443-cfd523ac1685(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9edda7f-2b5d-4b7c-8691-9af57cef83d5]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:32 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 Nov 01 09:04:32 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:33 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685" returned: 0 in 0.545s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:33 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a Nov 01 09:04:33 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:33 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a" returned: 0 in 0.343s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:33 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a Nov 01 09:04:33 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:33 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685.55a7642d-add1-4080-bcb5-95aa8818b15a" returned: 0 in 0.259s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-55a7642d-add1-4080-bcb5-95aa8818b15a" released by "_delete_snapshot" :: held 1.612s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-054d6606-7a28-4024-9443-cfd523ac1685" released by "delete_snapshot" :: held 1.636s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Created reservations ['b392e3d3-109c-422d-8478-aec29b06ba9c', '0eb75812-bfa0-4707-814e-a9d46c01b757', 'dd754c38-3646-45a5-8be1-7fe61d4a5db0', '3da2cccc-cb87-453d-9927-f63d77c6e58d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:34 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Delete snapshot completed successfully. Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-25c59b1d-e71b-4bf8-b5f3-15a0eb01d6e2 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-55a7642d-add1-4080-bcb5-95aa8818b15a-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-054d6606-7a28-4024-9443-cfd523ac1685-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Lock "cinder-054d6606-7a28-4024-9443-cfd523ac1685-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-quobyte-054d6606-7a28-4024-9443-cfd523ac1685" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-054d6606-7a28-4024-9443-cfd523ac1685" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2880fe36-9e23-4944-81fd-2f9984cba351]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:34 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 Nov 01 09:04:34 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:34 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685" returned: 0 in 0.411s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:35 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685 Nov 01 09:04:35 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Flow 'volume_create_manager' (f77f88e3-a3fb-4d12-96a5-1a36ae843148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f00e189-d47d-467d-b372-b3f37ec43f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:35 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f00e189-d47d-467d-b372-b3f37ec43f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-71953519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab3984a-0ee1-4127-9126-9dc8b8472f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93928bb7d8a348e1af0abaa03416b32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:35Z,use_quota=True,user_id='53862af1b1ee4713aceb00b1301a14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19403451-ff7f-406b-89bb-7bcc4978cebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19403451-ff7f-406b-89bb-7bcc4978cebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833d3109-ef20-4549-9811-2bc3c7788327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833d3109-ef20-4549-9811-2bc3c7788327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab3984a-0ee1-4127-9126-9dc8b8472f3a', 'volume_name': 'volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db960468-144e-43a6-8caa-8bafab29a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db960468-144e-43a6-8caa-8bafab29a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3cd4cb-dd4d-47e7-88be-76aa2070d19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Volume 3ab3984a-0ee1-4127-9126-9dc8b8472f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a', 'volume_size': 1} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-71953519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab3984a-0ee1-4127-9126-9dc8b8472f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93928bb7d8a348e1af0abaa03416b32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:35Z,use_quota=True,user_id='53862af1b1ee4713aceb00b1301a14b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Creating volume 3ab3984a-0ee1-4127-9126-9dc8b8472f3a {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:35 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-054d6606-7a28-4024-9443-cfd523ac1685" returned: 0 in 0.325s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:35 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a 1073741824 Nov 01 09:04:35 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-054d6606-7a28-4024-9443-cfd523ac1685" released by "delete_volume" :: held 0.811s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Created reservations ['973a7b4a-7cb0-4643-acfb-80ea8dfb5e52', '99af335b-2671-45a5-a921-7c4f2fb93a2a', '32e3531d-b3d9-400e-85d1-9fecd3038c67', '2141fa9c-b9f7-4147-a6da-5994c6ff3635'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:35 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:35 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-7a7ec0cf-6b1d-4792-bb8a-a452090f007f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-7a7ec0cf-6b1d-4792-bb8a-a452090f007f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:35 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "cinder-quobyte-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Deleted volume successfully. Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a050bc1-1971-4f5e-b09e-e6d4a9a63dad tempest-VolumeDependencyTests-664341783 None] Lock "cinder-054d6606-7a28-4024-9443-cfd523ac1685-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc6a787-0338-4e86-a07b-21ba3e4fe6d0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:35 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a 1073741824" returned: 0 in 0.551s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:35 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a Nov 01 09:04:35 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:35 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f Nov 01 09:04:35 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:36 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a" returned: 0 in 0.260s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3cd4cb-dd4d-47e7-88be-76aa2070d19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511045f4-99e1-46b2-bcde-e211b28adc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Volume volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a (3ab3984a-0ee1-4127-9126-9dc8b8472f3a): created successfully Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511045f4-99e1-46b2-bcde-e211b28adc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Flow 'volume_create_manager' (f77f88e3-a3fb-4d12-96a5-1a36ae843148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:36 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" returned: 0 in 0.405s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5615e7f6-afc6-4c8d-a3fe-d40ef9bc4e05 tempest-AttachVolumeNegativeTest-572358819 None] Created volume successfully. Nov 01 09:04:36 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f Nov 01 09:04:36 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:36 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-quobyte-7a7ec0cf-6b1d-4792-bb8a-a452090f007f" released by "delete_volume" :: held 0.730s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Created reservations ['df157e40-3f97-4a77-b00f-4c9d32591d4a', '4e089726-88bd-44dd-b231-d7796aa76dde', '166d0dc7-a7d0-4658-9ba3-ddaca99e8b7a', '02adf37d-8539-4255-a3a4-cf3b094ac615'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:36 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:36 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:36 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.245s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Deleted volume successfully. Nov 01 09:04:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fe8351cc-87b8-4d52-bbfd-709343c068c3 tempest-VolumeDependencyTests-664341783 None] Lock "cinder-7a7ec0cf-6b1d-4792-bb8a-a452090f007f-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-9b1b98ba-cb6c-4425-be24-590a59d72f3e req-6937f732-84c0-490c-9b1c-aa87e3f9fc46 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-9b1b98ba-cb6c-4425-be24-590a59d72f3e req-6937f732-84c0-490c-9b1c-aa87e3f9fc46 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-9b1b98ba-cb6c-4425-be24-590a59d72f3e req-6937f732-84c0-490c-9b1c-aa87e3f9fc46 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-9b1b98ba-cb6c-4425-be24-590a59d72f3e req-6937f732-84c0-490c-9b1c-aa87e3f9fc46 tempest-AttachVolumeNegativeTest-572358819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fec82787-d922-4d71-bed7-ef5ab50ddf99', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:04:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-9b1b98ba-cb6c-4425-be24-590a59d72f3e req-6937f732-84c0-490c-9b1c-aa87e3f9fc46 tempest-AttachVolumeNegativeTest-572358819 None] attachment_update completed successfully. Nov 01 09:04:40 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-43c13607-2c8c-4c6f-b347-0d12c7bdd48d req-66d0a027-838e-45a5-8aa1-bfd1db128374 tempest-AttachVolumeNegativeTest-572358819 None] Terminate volume connection completed successfully. Nov 01 09:04:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-43c13607-2c8c-4c6f-b347-0d12c7bdd48d req-66d0a027-838e-45a5-8aa1-bfd1db128374 tempest-AttachVolumeNegativeTest-572358819 None] Deleting attachment fec82787-d922-4d71-bed7-ef5ab50ddf99. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "cinder-3ab3984a-0ee1-4127-9126-9dc8b8472f3a-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-3ab3984a-0ee1-4127-9126-9dc8b8472f3a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=109,cinder:INSERT=32,cinder:UPDATE=120,cinder:DELETE=12 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=98,cinder:INSERT=33,cinder:UPDATE=130,cinder:DELETE=10 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "cinder-quobyte-3ab3984a-0ee1-4127-9126-9dc8b8472f3a" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-quobyte-3ab3984a-0ee1-4127-9126-9dc8b8472f3a" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091f540-44ff-4a6a-b26c-77bad3fd89b4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:46 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a Nov 01 09:04:46 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:46 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a" returned: 0 in 0.422s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:46 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a Nov 01 09:04:46 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:46 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3ab3984a-0ee1-4127-9126-9dc8b8472f3a" returned: 0 in 0.271s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-quobyte-3ab3984a-0ee1-4127-9126-9dc8b8472f3a" released by "delete_volume" :: held 0.741s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Created reservations ['881c5ded-667c-4d16-8f3c-db8485489264', 'fec85734-6c3d-446f-8ebb-fa9055e299fd', '44ef7164-85d8-4ca8-b71a-24d5d8d52856', '06422851-c84e-427e-a00b-2e8a5dc2f2b8'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:46 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:46 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:47 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Deleted volume successfully. Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0706805d-7234-40a4-b7a3-7a441c211256 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-3ab3984a-0ee1-4127-9126-9dc8b8472f3a-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "cinder-91e072e2-0420-4b03-97f9-b307e94dee66-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-91e072e2-0420-4b03-97f9-b307e94dee66-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "cinder-quobyte-91e072e2-0420-4b03-97f9-b307e94dee66" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-quobyte-91e072e2-0420-4b03-97f9-b307e94dee66" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f687f5-935f-4604-b289-eefa22a881e7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:47 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 Nov 01 09:04:47 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:47 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66" returned: 0 in 0.384s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:47 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66 Nov 01 09:04:47 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:47 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91e072e2-0420-4b03-97f9-b307e94dee66" returned: 0 in 0.268s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-quobyte-91e072e2-0420-4b03-97f9-b307e94dee66" released by "delete_volume" :: held 0.697s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Created reservations ['b55527c5-0bd2-42f7-916b-60d253924dbe', 'ca4c196e-7803-4d3c-a030-1480cbc3fbcd', 'f1f94f37-3933-4bb5-8011-6b52d01c8a73', '63c1521c-5cc0-459f-9433-a6f2e20f6633'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:48 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:48 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:48 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:48 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Deleted volume successfully. Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fa70b885-1de1-4bab-931e-accff61b38d2 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-91e072e2-0420-4b03-97f9-b307e94dee66-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "cinder-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "cinder-quobyte-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-quobyte-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8b6728-cf33-4d4a-b3bc-d13dfa3ef2d9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:48 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 Nov 01 09:04:48 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:48 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1" returned: 0 in 0.369s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:48 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1 Nov 01 09:04:48 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:49 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1" returned: 0 in 0.238s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-quobyte-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1" released by "delete_volume" :: held 0.660s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Created reservations ['dbebc74e-0894-4b3b-a1ce-cd2a8864fb40', 'd8f33dad-fcdb-4e61-84fc-fc5b5290f262', '6312e2ac-475f-4a31-85cf-dd181ffb2893', 'a6b0939c-c6eb-43df-bb2a-5bb42b700b50'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:49 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:04:49 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:49 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.246s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:04:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Deleted volume successfully. Nov 01 09:04:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e7652682-224d-49fc-b480-0031a66a8a23 tempest-AttachVolumeNegativeTest-572358819 None] Lock "cinder-0effb830-0a8f-42d1-a49e-fd8fa8d4abf1-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Flow 'volume_create_manager' (4a13c599-c826-4e69-9873-c5947e880148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d59543-2538-4114-b015-8c23a6700cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d59543-2538-4114-b015-8c23a6700cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522373710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557b81a3-bc6a-43a8-9216-3942aa712751,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='352e46c2a47144f89f42f5de213b32f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:57Z,use_quota=True,user_id='1ae001a282e04a81acb87bd86eae8336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2ad77f-b9c4-450b-a3a9-dc68ddb20ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2ad77f-b9c4-450b-a3a9-dc68ddb20ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a44d2be-2721-46ba-9827-855526cf9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a44d2be-2721-46ba-9827-855526cf9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557b81a3-bc6a-43a8-9216-3942aa712751', 'volume_name': 'volume-557b81a3-bc6a-43a8-9216-3942aa712751', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed43bd-44f4-4230-88b3-7f740ac30c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed43bd-44f4-4230-88b3-7f740ac30c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63a44a6-845d-4d72-b1ce-138b9560f1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:56 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Volume 557b81a3-bc6a-43a8-9216-3942aa712751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557b81a3-bc6a-43a8-9216-3942aa712751', 'volume_size': 1} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-522373710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557b81a3-bc6a-43a8-9216-3942aa712751,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='352e46c2a47144f89f42f5de213b32f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:57Z,use_quota=True,user_id='1ae001a282e04a81acb87bd86eae8336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Creating volume 557b81a3-bc6a-43a8-9216-3942aa712751 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:56 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:56 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 1073741824 Nov 01 09:04:56 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:57 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 1073741824" returned: 0 in 0.422s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:57 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 Nov 01 09:04:57 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:57 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e63a44a6-845d-4d72-b1ce-138b9560f1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557b81a3-bc6a-43a8-9216-3942aa712751', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f582fd-65bc-4b4f-b982-3346fafa988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:57 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Volume volume-557b81a3-bc6a-43a8-9216-3942aa712751 (557b81a3-bc6a-43a8-9216-3942aa712751): created successfully Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f582fd-65bc-4b4f-b982-3346fafa988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Flow 'volume_create_manager' (4a13c599-c826-4e69-9873-c5947e880148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5b2605b9-3f3b-4590-a58b-31fdbf997eea tempest-VolumesTestJSON-861893599 None] Created volume successfully. Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Flow 'volume_create_manager' (f5edc546-8a54-4e4a-b7f3-234ffbdb25bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fa4136-0233-4a3a-86c9-139317eb7c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fa4136-0233-4a3a-86c9-139317eb7c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-262759164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f946430b-125e-45d1-9f09-d4ab54fe8f64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='352e46c2a47144f89f42f5de213b32f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:58Z,use_quota=True,user_id='1ae001a282e04a81acb87bd86eae8336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c6d9a4-44d4-4521-ad5b-e6f680bc8b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c6d9a4-44d4-4521-ad5b-e6f680bc8b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bb6719-cdc2-42c0-a1ea-2b31af171d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bb6719-cdc2-42c0-a1ea-2b31af171d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f946430b-125e-45d1-9f09-d4ab54fe8f64', 'volume_name': 'volume-f946430b-125e-45d1-9f09-d4ab54fe8f64', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f854ba-b011-46ef-9ebd-394e6497438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f854ba-b011-46ef-9ebd-394e6497438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1aa155-1a4a-415a-9473-a95adc3b2290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:58 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Volume f946430b-125e-45d1-9f09-d4ab54fe8f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f946430b-125e-45d1-9f09-d4ab54fe8f64', 'volume_size': 1} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-262759164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f946430b-125e-45d1-9f09-d4ab54fe8f64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='352e46c2a47144f89f42f5de213b32f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:04:58Z,use_quota=True,user_id='1ae001a282e04a81acb87bd86eae8336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Creating volume f946430b-125e-45d1-9f09-d4ab54fe8f64 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:04:58 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:58 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 1073741824 Nov 01 09:04:58 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:58 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 1073741824" returned: 0 in 0.403s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:04:58 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 Nov 01 09:04:58 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:04:59 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64" returned: 0 in 0.260s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a1aa155-1a4a-415a-9473-a95adc3b2290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f946430b-125e-45d1-9f09-d4ab54fe8f64', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4345759-bc4a-4543-8a53-ee615d3543c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:04:59 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Volume volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 (f946430b-125e-45d1-9f09-d4ab54fe8f64): created successfully Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4345759-bc4a-4543-8a53-ee615d3543c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Flow 'volume_create_manager' (f5edc546-8a54-4e4a-b7f3-234ffbdb25bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:04:59 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-44e48d7b-30f1-4a31-b569-c9f86dfca945 tempest-VolumesTestJSON-861893599 None] Created volume successfully. Nov 01 09:04:59 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Flow 'volume_create_manager' (f5303555-f431-4a4c-861b-bbee8c0caef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ec1146-0c64-404b-8e70-a90b77658e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ec1146-0c64-404b-8e70-a90b77658e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1271499524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8165e398-6bf0-4570-952e-c9c54672aace,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='352e46c2a47144f89f42f5de213b32f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:00Z,use_quota=True,user_id='1ae001a282e04a81acb87bd86eae8336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2755fdd-fa56-4d41-a6dc-f1942feec8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2755fdd-fa56-4d41-a6dc-f1942feec8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf12faa-d457-4785-981f-337a626cf579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf12faa-d457-4785-981f-337a626cf579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8165e398-6bf0-4570-952e-c9c54672aace', 'volume_name': 'volume-8165e398-6bf0-4570-952e-c9c54672aace', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2520786-f66b-47d7-910b-850eb6004c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2520786-f66b-47d7-910b-850eb6004c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af990da9-7e3d-4213-8a12-fec6bb94d060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Volume 8165e398-6bf0-4570-952e-c9c54672aace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8165e398-6bf0-4570-952e-c9c54672aace', 'volume_size': 1} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1271499524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8165e398-6bf0-4570-952e-c9c54672aace,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='352e46c2a47144f89f42f5de213b32f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:00Z,use_quota=True,user_id='1ae001a282e04a81acb87bd86eae8336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Creating volume 8165e398-6bf0-4570-952e-c9c54672aace {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:05:00 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:00 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace 1073741824 Nov 01 09:05:00 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:00 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace 1073741824" returned: 0 in 0.408s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:00 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace Nov 01 09:05:00 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:00 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace" returned: 0 in 0.233s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af990da9-7e3d-4213-8a12-fec6bb94d060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8165e398-6bf0-4570-952e-c9c54672aace', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a84ff4-90bb-47b7-b35a-f4d11e03a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Volume volume-8165e398-6bf0-4570-952e-c9c54672aace (8165e398-6bf0-4570-952e-c9c54672aace): created successfully Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a84ff4-90bb-47b7-b35a-f4d11e03a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Flow 'volume_create_manager' (f5303555-f431-4a4c-861b-bbee8c0caef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0051beda-ac7a-4153-bc9d-9adaa7c08212 tempest-VolumesTestJSON-861893599 None] Created volume successfully. Nov 01 09:05:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Acquiring lock "cinder-8165e398-6bf0-4570-952e-c9c54672aace-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Lock "cinder-8165e398-6bf0-4570-952e-c9c54672aace-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Acquiring lock "cinder-quobyte-8165e398-6bf0-4570-952e-c9c54672aace" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Lock "cinder-quobyte-8165e398-6bf0-4570-952e-c9c54672aace" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fdffe8-e831-4ad1-9aeb-0a540d0118c9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:01 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace Nov 01 09:05:01 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:02 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace" returned: 0 in 0.349s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:02 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace Nov 01 09:05:02 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:02 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8165e398-6bf0-4570-952e-c9c54672aace" returned: 0 in 0.254s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Lock "cinder-quobyte-8165e398-6bf0-4570-952e-c9c54672aace" released by "delete_volume" :: held 0.645s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Created reservations ['ed3f021c-ffc0-4d31-a699-11d0792076e9', '380e68e8-2f0f-4155-ada6-5ad6cccdb661', 'f21ce9bd-40cd-4f18-8d4d-1ffa0e194e8a', 'd0829b35-4c3b-40b7-a4f7-7f4fc943f5bd'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:02 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:02 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:02 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.258s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Deleted volume successfully. Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b60a1a8f-86f5-4885-9584-108c873dd79e tempest-VolumesTestJSON-861893599 None] Lock "cinder-8165e398-6bf0-4570-952e-c9c54672aace-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Acquiring lock "cinder-f946430b-125e-45d1-9f09-d4ab54fe8f64-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Lock "cinder-f946430b-125e-45d1-9f09-d4ab54fe8f64-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Acquiring lock "cinder-quobyte-f946430b-125e-45d1-9f09-d4ab54fe8f64" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Lock "cinder-quobyte-f946430b-125e-45d1-9f09-d4ab54fe8f64" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6008adf1-01d1-4942-a2bd-4cf9d9baf1e7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:03 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 Nov 01 09:05:03 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:03 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64" returned: 0 in 0.349s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:03 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64 Nov 01 09:05:03 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:03 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-f946430b-125e-45d1-9f09-d4ab54fe8f64" returned: 0 in 0.251s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Lock "cinder-quobyte-f946430b-125e-45d1-9f09-d4ab54fe8f64" released by "delete_volume" :: held 0.642s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Created reservations ['c4dfb4c9-ae82-4b1a-9937-7a98dcf69127', '3fc8207e-d84d-4a6a-8a28-0d50ee1c3707', '06b74566-b336-418e-b30f-81d3ed631bd7', '818017dd-1219-4cad-b628-c1cca87fff11'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:03 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:03 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:03 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Deleted volume successfully. Nov 01 09:05:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0ab7e39a-9ce3-4cfd-a7ec-caf1b67d30d4 tempest-VolumesTestJSON-861893599 None] Lock "cinder-f946430b-125e-45d1-9f09-d4ab54fe8f64-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Acquiring lock "cinder-557b81a3-bc6a-43a8-9216-3942aa712751-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Lock "cinder-557b81a3-bc6a-43a8-9216-3942aa712751-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Acquiring lock "cinder-quobyte-557b81a3-bc6a-43a8-9216-3942aa712751" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Lock "cinder-quobyte-557b81a3-bc6a-43a8-9216-3942aa712751" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf01d540-ab6b-4f52-aecc-6218235d00cb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:04 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 Nov 01 09:05:04 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:04 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751" returned: 0 in 0.344s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:04 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751 Nov 01 09:05:04 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:04 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-557b81a3-bc6a-43a8-9216-3942aa712751" returned: 0 in 0.232s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Lock "cinder-quobyte-557b81a3-bc6a-43a8-9216-3942aa712751" released by "delete_volume" :: held 0.616s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Created reservations ['6147b907-59ec-4723-a92f-27a565d21c39', 'edf27ba9-7268-4d97-bee9-fa410afd5317', 'faaac43a-3100-4fb2-b1d2-1ce87cbb5367', 'ff960d37-48db-4d52-81d5-7c0b95d17a14'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:04 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:04 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.231s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:05 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:05 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Deleted volume successfully. Nov 01 09:05:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9fd1a4f3-6829-4909-873e-962a9d6bb3c8 tempest-VolumesTestJSON-861893599 None] Lock "cinder-557b81a3-bc6a-43a8-9216-3942aa712751-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-de72dc66-c32f-4cc5-b874-8ce2b2ac9a56 tempest-GroupSnapshotsTest-169053504 None] Group tempest-GroupSnapshotsTest-Group-318503296: creating Nov 01 09:05:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-de72dc66-c32f-4cc5-b874-8ce2b2ac9a56 tempest-GroupSnapshotsTest-169053504 None] Group tempest-GroupSnapshotsTest-Group-318503296: created successfully Nov 01 09:05:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-de72dc66-c32f-4cc5-b874-8ce2b2ac9a56 tempest-GroupSnapshotsTest-169053504 None] Create group completed successfully. Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (90934301-a54e-49da-bb3b-ce4053d2d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bc2e5a-433c-4b85-9603-4284bdfea669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bc2e5a-433c-4b85-9603-4284bdfea669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283353807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fb135fd-1e1b-4268-924f-0201773bcd71,host='devstack@QuobyteHD#QuobyteHD',id=23f476d0-18d5-4666-ba08-2bcf81d7a34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:11Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6079e14-1455-4c9b-a6ad-827b2b6ac826),volume_type_id=b6079e14-1455-4c9b-a6ad-827b2b6ac826)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d828e9-f5aa-4841-8377-cc22aac023a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d828e9-f5aa-4841-8377-cc22aac023a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64e0902-4cd2-48c3-8991-31d3d681d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64e0902-4cd2-48c3-8991-31d3d681d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f476d0-18d5-4666-ba08-2bcf81d7a34a', 'volume_name': 'volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9a95c6-3c1b-4ab3-a368-e3fe58c04475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9a95c6-3c1b-4ab3-a368-e3fe58c04475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc0ce47-2c94-4ed8-b3f4-ed2e893f9c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:10 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Volume 23f476d0-18d5-4666-ba08-2bcf81d7a34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a', 'volume_size': 1} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fb135fd-1e1b-4268-924f-0201773bcd71,created_at=2026-11-01T08:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1283353807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fb135fd-1e1b-4268-924f-0201773bcd71,host='devstack@QuobyteHD#QuobyteHD',id=23f476d0-18d5-4666-ba08-2bcf81d7a34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:11Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6079e14-1455-4c9b-a6ad-827b2b6ac826),volume_type_id=b6079e14-1455-4c9b-a6ad-827b2b6ac826)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Creating volume 23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:05:10 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:05:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:10 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a 1073741824 Nov 01 09:05:10 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:11 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a 1073741824" returned: 0 in 0.408s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:11 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a Nov 01 09:05:11 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:11 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a" returned: 0 in 0.255s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc0ce47-2c94-4ed8-b3f4-ed2e893f9c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a41b007-b7c4-4c4e-90f7-ed04057a00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:11 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Volume volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a (23f476d0-18d5-4666-ba08-2bcf81d7a34a): created successfully Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a41b007-b7c4-4c4e-90f7-ed04057a00e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (90934301-a54e-49da-bb3b-ce4053d2d993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-23845890-3d23-4f6c-8f38-bb999740442e tempest-GroupSnapshotsTest-169053504 None] Created volume successfully. Nov 01 09:05:12 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] GroupSnapshot 5d723330-a635-4f40-a57d-2a8cd3420543: creating. Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Group snapshot 5d723330-a635-4f40-a57d-2a8cd3420543: creating. {{(pid=86770) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Creating offline snapshot 1a03c387-6289-4d8a-90fe-38ce837d2654 of volume 23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[40311650-9f2a-490e-958f-ef957528299d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:12 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a Nov 01 09:05:12 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:12 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:12 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 1G Nov 01 09:05:12 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:13 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 1G" returned: 0 in 0.386s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:13 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 Nov 01 09:05:13 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:13 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654" returned: 0 in 0.299s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:13 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:13 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 Nov 01 09:05:13 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:13 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654" returned: 0 in 0.263s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:13 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.info Nov 01 09:05:13 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:13 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.info" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:13 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:13 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.info Nov 01 09:05:13 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:14 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.info" returned: 0 in 0.228s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:14 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5e2959cc-75eb-443b-8c03-8e0503e62424 tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5d723330-a635-4f40-a57d-2a8cd3420543: created successfully Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-1a03c387-6289-4d8a-90fe-38ce837d2654-24635fb1-162d-46aa-9f04-0c511a52f9f5" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-1a03c387-6289-4d8a-90fe-38ce837d2654-24635fb1-162d-46aa-9f04-0c511a52f9f5" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Creating volume 24635fb1-162d-46aa-9f04-0c511a52f9f5 from snapshot 1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-24635fb1-162d-46aa-9f04-0c511a52f9f5" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-24635fb1-162d-46aa-9f04-0c511a52f9f5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] snapshot: 1a03c387-6289-4d8a-90fe-38ce837d2654, volume: 24635fb1-162d-46aa-9f04-0c511a52f9f5, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[20234ef5-79e5-45af-8736-5f4d69686169]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:15 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 Nov 01 09:05:15 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:15 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654" returned: 0 in 0.367s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[876901be-289b-4b3d-8964-2db587e05cf8]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:15 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a Nov 01 09:05:15 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:15 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a" returned: 0 in 0.349s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:05:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:15 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 Nov 01 09:05:15 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:21 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:21 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:21 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5" returned: 0 in 5.887s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:05:21 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Converted 1024.00 MB image at 173.89 MB/s Nov 01 09:05:21 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:21 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 Nov 01 09:05:21 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:21 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:05:21 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-24635fb1-162d-46aa-9f04-0c511a52f9f5" released by "_copy_volume_from_snapshot" :: held 6.926s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-1a03c387-6289-4d8a-90fe-38ce837d2654-24635fb1-162d-46aa-9f04-0c511a52f9f5" released by "_create_volume_from_snapshot" :: held 6.988s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:22 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ea16f76d-c95a-491e-9684-349b618dc272 tempest-GroupSnapshotsTest-169053504 None] Create group from source-snapshot-5d723330-a635-4f40-a57d-2a8cd3420543 completed successfully. Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-24635fb1-162d-46aa-9f04-0c511a52f9f5" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-24635fb1-162d-46aa-9f04-0c511a52f9f5" acquired by "delete_volume" :: waited 0.012s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[634dbf3a-f9aa-4c6f-8c5c-e069d459f20a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:23 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 Nov 01 09:05:23 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:23 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5" returned: 0 in 0.372s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:23 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5 Nov 01 09:05:23 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:23 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-24635fb1-162d-46aa-9f04-0c511a52f9f5" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-24635fb1-162d-46aa-9f04-0c511a52f9f5" released by "delete_volume" :: held 0.652s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:23 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['204f7bd5-ef38-42a2-a988-ded3714dd723'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:24 devstack cinder-volume[86770]: WARNING cinder.quota [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1215930304 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1215930304, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:24 devstack cinder-volume[86770]: WARNING cinder.quota [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1215930304 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1215930304, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['8b4deae0-e1c0-489a-b981-32cb0331be07', '010d7004-2bf2-406a-b8e8-034ff12ae145', '0b1a0778-64d9-4873-b7d5-4cb5addd2d09', '05bce96f-0d5a-4b44-b734-54df7c726af2'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:24 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:24 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:24 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-920dd90a-c975-4187-90ac-dc31ace85ec3 tempest-GroupSnapshotsTest-169053504 None] Delete group completed successfully. Nov 01 09:05:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5d723330-a635-4f40-a57d-2a8cd3420543: deleting Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5d723330-a635-4f40-a57d-2a8cd3420543: deleting {{(pid=86770) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-23f476d0-18d5-4666-ba08-2bcf81d7a34a" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-23f476d0-18d5-4666-ba08-2bcf81d7a34a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-1a03c387-6289-4d8a-90fe-38ce837d2654" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-1a03c387-6289-4d8a-90fe-38ce837d2654" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Deleting offline snapshot 1a03c387-6289-4d8a-90fe-38ce837d2654 of volume 23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] snapshot_file for this snap is: volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[df85c9a4-9695-4df0-bec7-5b5fb7ef54b3]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:24 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 Nov 01 09:05:24 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:24 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654" returned: 0 in 0.360s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:05:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c4490e-1b01-4768-9f12-3c33eba9137a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:25 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a Nov 01 09:05:25 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:25 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a" returned: 0 in 0.571s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:25 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 Nov 01 09:05:25 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:25 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654" returned: 0 in 0.351s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:25 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654 Nov 01 09:05:25 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:26 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a.1a03c387-6289-4d8a-90fe-38ce837d2654" returned: 0 in 0.264s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-1a03c387-6289-4d8a-90fe-38ce837d2654" released by "_delete_snapshot" :: held 1.648s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-23f476d0-18d5-4666-ba08-2bcf81d7a34a" released by "delete_snapshot" :: held 1.673s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:26 devstack cinder-volume[86770]: WARNING cinder.quota [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1215930304 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1215930304, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:26 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] Created reservations ['d7851e2e-c6aa-4581-ad29-ef61aab88a43', '3b17b487-72f4-49cb-a664-bb1a573f5895', '93ec2f4c-0bef-4e0d-81a8-1654e4130487', '85ddc9ea-6b5a-47a7-85b5-d7449b568810'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:26 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-39395ccb-316d-4534-bb91-3127de51d06a tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5d723330-a635-4f40-a57d-2a8cd3420543: deleted successfully Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-23f476d0-18d5-4666-ba08-2bcf81d7a34a" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-23f476d0-18d5-4666-ba08-2bcf81d7a34a" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3bf552-8fb0-46ef-ac35-7de296cb7c0b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:27 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a Nov 01 09:05:27 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:27 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:27 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a Nov 01 09:05:27 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:27 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-23f476d0-18d5-4666-ba08-2bcf81d7a34a" returned: 0 in 0.255s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-23f476d0-18d5-4666-ba08-2bcf81d7a34a" released by "delete_volume" :: held 0.714s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['28fd723c-1980-41ea-9926-3a17bb186d5a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:27 devstack cinder-volume[86770]: WARNING cinder.db.api [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1215930304'] Nov 01 09:05:27 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['a4a677d0-395c-40c8-8d38-fe780397c2c6', '37116119-b724-47a3-a4a2-b59e303960a9', 'b65344e7-dca1-428c-9f04-8a64d2a3eaa9', '50f619e1-542f-4a16-a85d-f6721054eddb'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:28 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:28 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:28 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.285s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:28 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-46c28f90-ccdb-4210-ab59-377f534c1914 tempest-GroupSnapshotsTest-169053504 None] Delete group completed successfully. Nov 01 09:05:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8c1141f4-047c-4c29-8ae2-232e0e740493 tempest-GroupSnapshotsTest-169053504 None] Group tempest-GroupSnapshotsTest-Group-748061670: creating Nov 01 09:05:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8c1141f4-047c-4c29-8ae2-232e0e740493 tempest-GroupSnapshotsTest-169053504 None] Group tempest-GroupSnapshotsTest-Group-748061670: created successfully Nov 01 09:05:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8c1141f4-047c-4c29-8ae2-232e0e740493 tempest-GroupSnapshotsTest-169053504 None] Create group completed successfully. Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (346acc53-c5ac-4d10-81fb-c4a5c5f5639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d075c69e-02db-42c6-889c-f7de79f1cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d075c69e-02db-42c6-889c-f7de79f1cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331711372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80b21f8c-4f21-40bb-902b-ca72a0510e24,host='devstack@QuobyteHD#QuobyteHD',id=a3e8fa91-88f3-4e90-86e6-f4c5a0109da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:30Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0624d0-20c9-4c87-83d0-0557440b9ac6),volume_type_id=3e0624d0-20c9-4c87-83d0-0557440b9ac6)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86a1ffb-0249-4155-89da-4e2c14fb3a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86a1ffb-0249-4155-89da-4e2c14fb3a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e24e2f-ff9d-4ce6-a341-0214557bb9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e24e2f-ff9d-4ce6-a341-0214557bb9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e8fa91-88f3-4e90-86e6-f4c5a0109da4', 'volume_name': 'volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c045bf-4c33-40c0-8693-24cea066fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c045bf-4c33-40c0-8693-24cea066fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1a4873-c925-4b21-8904-2a0c9ffc4c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:30 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Volume a3e8fa91-88f3-4e90-86e6-f4c5a0109da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4', 'volume_size': 1} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=80b21f8c-4f21-40bb-902b-ca72a0510e24,created_at=2026-11-01T08:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331711372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80b21f8c-4f21-40bb-902b-ca72a0510e24,host='devstack@QuobyteHD#QuobyteHD',id=a3e8fa91-88f3-4e90-86e6-f4c5a0109da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:30Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0624d0-20c9-4c87-83d0-0557440b9ac6),volume_type_id=3e0624d0-20c9-4c87-83d0-0557440b9ac6)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Creating volume a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:05:30 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:30 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 1073741824 Nov 01 09:05:30 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:30 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 1073741824" returned: 0 in 0.447s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:30 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 Nov 01 09:05:30 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:31 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" returned: 0 in 0.262s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:05:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1a4873-c925-4b21-8904-2a0c9ffc4c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587b6999-bc8c-4516-9f72-ebba5aefcea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Volume volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 (a3e8fa91-88f3-4e90-86e6-f4c5a0109da4): created successfully Nov 01 09:05:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587b6999-bc8c-4516-9f72-ebba5aefcea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (346acc53-c5ac-4d10-81fb-c4a5c5f5639e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-242bacb3-1c3a-4fd1-a27b-dd63bbe3c9db tempest-GroupSnapshotsTest-169053504 None] Created volume successfully. Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (60a9ef99-797c-4856-8c0c-159e70e19684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cc89b5-f2c3-4774-9e83-fc54c8e81d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cc89b5-f2c3-4774-9e83-fc54c8e81d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-747513635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80b21f8c-4f21-40bb-902b-ca72a0510e24,host='devstack@QuobyteHD#QuobyteHD',id=cc304bfb-f524-4e36-89bb-0aace2b185d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:32Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0624d0-20c9-4c87-83d0-0557440b9ac6),volume_type_id=3e0624d0-20c9-4c87-83d0-0557440b9ac6)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ff555f-87a0-4268-9278-1127537d1ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ff555f-87a0-4268-9278-1127537d1ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec51a6df-de55-460c-864b-6705d20b6cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec51a6df-de55-460c-864b-6705d20b6cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc304bfb-f524-4e36-89bb-0aace2b185d8', 'volume_name': 'volume-cc304bfb-f524-4e36-89bb-0aace2b185d8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8883f721-c923-424f-876d-cc0f11c4b633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8883f721-c923-424f-876d-cc0f11c4b633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b6c056-5d38-488f-a8b9-fd373d600c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:32 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Volume cc304bfb-f524-4e36-89bb-0aace2b185d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc304bfb-f524-4e36-89bb-0aace2b185d8', 'volume_size': 1} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=80b21f8c-4f21-40bb-902b-ca72a0510e24,created_at=2026-11-01T08:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-747513635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80b21f8c-4f21-40bb-902b-ca72a0510e24,host='devstack@QuobyteHD#QuobyteHD',id=cc304bfb-f524-4e36-89bb-0aace2b185d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:32Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0624d0-20c9-4c87-83d0-0557440b9ac6),volume_type_id=3e0624d0-20c9-4c87-83d0-0557440b9ac6)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Creating volume cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:05:32 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:32 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 1073741824 Nov 01 09:05:32 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:32 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 1073741824" returned: 0 in 0.419s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:32 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 Nov 01 09:05:32 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:32 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b6c056-5d38-488f-a8b9-fd373d600c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc304bfb-f524-4e36-89bb-0aace2b185d8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca241e6-308c-476d-ab86-d14aefe09d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:32 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Volume volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 (cc304bfb-f524-4e36-89bb-0aace2b185d8): created successfully Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca241e6-308c-476d-ab86-d14aefe09d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (60a9ef99-797c-4856-8c0c-159e70e19684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-aee6137f-6ff3-4cf4-b047-9fff9cda378d tempest-GroupSnapshotsTest-169053504 None] Created volume successfully. Nov 01 09:05:33 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c0eda60b-3847-45f6-a108-0ca741aef126 tempest-GroupSnapshotsTest-169053504 None] Update group completed successfully. Nov 01 09:05:34 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5dfcf0a6-cd1f-45dd-9689-18e18309e8fc tempest-GroupSnapshotsTest-169053504 None] Update group completed successfully. Nov 01 09:05:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-05fa7716-8ab2-468c-b518-b1eaa93ed4cd tempest-GroupSnapshotsTest-169053504 None] Update group completed successfully. Nov 01 09:05:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f919feed-63fa-48a9-9a20-cfcc93cc12fb tempest-GroupSnapshotsTest-169053504 None] Update group completed successfully. Nov 01 09:05:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] GroupSnapshot 5ceb2c6f-af11-4488-8798-4019cc2d212d: creating. Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Group snapshot 5ceb2c6f-af11-4488-8798-4019cc2d212d: creating. {{(pid=86770) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Creating offline snapshot bd58aab1-d15b-4201-b3ab-a843a95fc975 of volume cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e4de6f-66fb-45cd-935c-b4f0c3d6438e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:38 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 Nov 01 09:05:38 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:38 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:38 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 1G Nov 01 09:05:38 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:39 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 1G" returned: 0 in 0.386s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:39 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 Nov 01 09:05:39 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:39 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975" returned: 0 in 0.306s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:39 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:39 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 Nov 01 09:05:39 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:39 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975" returned: 0 in 0.245s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:39 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.info Nov 01 09:05:39 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:40 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.info" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:40 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:40 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.info Nov 01 09:05:40 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:40 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.info" returned: 0 in 0.248s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Creating offline snapshot d91aa512-7ed7-4d70-9b25-2c3995e538f0 of volume a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28afec6-4c7b-48a8-addf-dd8d96a8eda6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:40 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 Nov 01 09:05:40 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:40 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" returned: 0 in 0.364s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:40 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 1G Nov 01 09:05:40 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:41 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 1G" returned: 0 in 0.421s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:41 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 Nov 01 09:05:41 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:41 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:41 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:41 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 Nov 01 09:05:41 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:41 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:41 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.info Nov 01 09:05:41 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:41 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.info" returned: 0 in 0.243s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:41 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:41 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.info Nov 01 09:05:41 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:42 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.info" returned: 0 in 0.238s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6f7fd91b-7e7e-453f-94a7-dd6e6f4e09f9 tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5ceb2c6f-af11-4488-8798-4019cc2d212d: created successfully Nov 01 09:05:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5ceb2c6f-af11-4488-8798-4019cc2d212d: deleting Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5ceb2c6f-af11-4488-8798-4019cc2d212d: deleting {{(pid=86770) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-cc304bfb-f524-4e36-89bb-0aace2b185d8" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-cc304bfb-f524-4e36-89bb-0aace2b185d8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-bd58aab1-d15b-4201-b3ab-a843a95fc975" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-bd58aab1-d15b-4201-b3ab-a843a95fc975" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Deleting offline snapshot bd58aab1-d15b-4201-b3ab-a843a95fc975 of volume cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] snapshot_file for this snap is: volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f180d505-5f07-4892-8b42-a55a42c430b3]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:42 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 Nov 01 09:05:42 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:43 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975" returned: 0 in 0.381s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc304bfb-f524-4e36-89bb-0aace2b185d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d6e83-f856-4a72-a50e-12ce7c8e3499]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:43 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 Nov 01 09:05:43 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:43 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8" returned: 0 in 0.365s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:43 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 Nov 01 09:05:43 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:43 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975" returned: 0 in 0.313s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:43 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975 Nov 01 09:05:43 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:44 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8.bd58aab1-d15b-4201-b3ab-a843a95fc975" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-bd58aab1-d15b-4201-b3ab-a843a95fc975" released by "_delete_snapshot" :: held 1.408s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-cc304bfb-f524-4e36-89bb-0aace2b185d8" released by "delete_snapshot" :: held 1.429s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-d91aa512-7ed7-4d70-9b25-2c3995e538f0" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-d91aa512-7ed7-4d70-9b25-2c3995e538f0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Deleting offline snapshot d91aa512-7ed7-4d70-9b25-2c3995e538f0 of volume a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] snapshot_file for this snap is: volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b2aa99-42e5-40fb-90a4-79e42292065e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:44 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 Nov 01 09:05:44 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:44 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0" returned: 0 in 0.371s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c9a2f0-90b5-4221-849f-8df11a7cca6a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:44 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 Nov 01 09:05:44 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:45 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" returned: 0 in 0.354s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:45 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 Nov 01 09:05:45 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:45 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0" returned: 0 in 0.340s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:45 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0 Nov 01 09:05:45 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:45 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4.d91aa512-7ed7-4d70-9b25-2c3995e538f0" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-d91aa512-7ed7-4d70-9b25-2c3995e538f0" released by "_delete_snapshot" :: held 1.401s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" released by "delete_snapshot" :: held 1.424s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:45 devstack cinder-volume[86770]: WARNING cinder.quota [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-18903228 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-18903228, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:45 devstack cinder-volume[86770]: WARNING cinder.quota [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-18903228 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-18903228, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['59e7923e-18d3-44e2-ba99-fb2633cccf1d', 'c2dc4dca-7a86-4f87-9a75-36dca99535e3', '88730c63-2327-4c55-a4b7-2b17a5a5d88b', '8af587b7-fbe4-4aba-a432-23e0a9248922'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['282a8949-af91-4e18-a60a-2a0c93f349ef', '78bd9924-2e64-4fed-bad6-5d89a8364b24', 'be5b46ab-d57e-48f3-a334-0a6c149424b6', '4e4d9e23-714f-46b4-927c-92d3eb5e1042'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=107,cinder:INSERT=25,cinder:UPDATE=114,cinder:DELETE=5 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:05:45 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=108,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=7 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:05:45 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-171606be-183c-42c3-9d52-17695398e172 tempest-GroupSnapshotsTest-169053504 None] group_snapshot 5ceb2c6f-af11-4488-8798-4019cc2d212d: deleted successfully Nov 01 09:05:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:46 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:46 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbb781f-5ae9-485c-b265-39b54710d578]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:46 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 Nov 01 09:05:46 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:46 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" returned: 0 in 0.365s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:47 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4 Nov 01 09:05:47 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:47 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-a3e8fa91-88f3-4e90-86e6-f4c5a0109da4" released by "delete_volume" :: held 0.688s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-cc304bfb-f524-4e36-89bb-0aace2b185d8" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-cc304bfb-f524-4e36-89bb-0aace2b185d8" acquired by "delete_volume" :: waited 0.013s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff74512d-a3c9-427f-9d56-3803cc082aaa]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:47 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 Nov 01 09:05:47 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:47 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8" returned: 0 in 0.354s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:47 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8 Nov 01 09:05:47 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:47 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cc304bfb-f524-4e36-89bb-0aace2b185d8" returned: 0 in 0.258s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:47 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-cc304bfb-f524-4e36-89bb-0aace2b185d8" released by "delete_volume" :: held 0.670s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['b0b31700-ba39-412e-9a5e-1e4fb969a95a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:48 devstack cinder-volume[86770]: WARNING cinder.quota [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-18903228 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-18903228, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['a18bb3fa-3dbc-41f1-90e2-dd2eeb8e14cc', '9eedd78a-63e3-4a08-80f8-ee047a25d0f7', '34d8b471-95b4-4939-8d75-45631a5a0dcf', 'a553635b-0c39-4f8b-952e-9cd416fb27a9'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['dde9cc74-c917-4b04-a136-fc9da3155e66', '504e3194-c1ee-48d4-9fb9-7c6350245a4b', 'd235e95b-235c-4a67-9f90-722968a34562', 'dc8661b4-ec7a-489c-82e6-15b1f99bd096'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:48 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:48 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:48 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:48 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:48 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c5ac3e7a-9e6c-4f13-956c-d23af9f68252 tempest-GroupSnapshotsTest-169053504 None] Delete group completed successfully. Nov 01 09:05:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cff8c031-cafb-41aa-9321-f1eebe1af27f tempest-GroupSnapshotsTest-169053504 None] Group tempest-GroupSnapshotsTest-Group-373901421: creating Nov 01 09:05:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cff8c031-cafb-41aa-9321-f1eebe1af27f tempest-GroupSnapshotsTest-169053504 None] Group tempest-GroupSnapshotsTest-Group-373901421: created successfully Nov 01 09:05:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cff8c031-cafb-41aa-9321-f1eebe1af27f tempest-GroupSnapshotsTest-169053504 None] Create group completed successfully. Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (5d0d393c-2af2-4d8a-8c0e-c883323f196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17bde8d-f370-4002-a62b-b14abe84827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17bde8d-f370-4002-a62b-b14abe84827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-741292282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fc5bc73-0dd4-4c5a-bc9f-077380774e99,host='devstack@QuobyteHD#QuobyteHD',id=787db324-e974-4335-b4c0-a35b96d8f256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:51Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e34d3d2-be67-4dda-a3e9-1621f1955008),volume_type_id=9e34d3d2-be67-4dda-a3e9-1621f1955008)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab2c17-952d-4e53-8a74-5d3c5e552f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab2c17-952d-4e53-8a74-5d3c5e552f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf906a-3573-414d-abe9-049d26bfcc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cf906a-3573-414d-abe9-049d26bfcc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787db324-e974-4335-b4c0-a35b96d8f256', 'volume_name': 'volume-787db324-e974-4335-b4c0-a35b96d8f256', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcade56-ceab-4e64-b9e7-51cb520bd68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcade56-ceab-4e64-b9e7-51cb520bd68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981ac4d0-6ee1-4ffc-ae75-ce0956ed7811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Volume 787db324-e974-4335-b4c0-a35b96d8f256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787db324-e974-4335-b4c0-a35b96d8f256', 'volume_size': 1} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fc5bc73-0dd4-4c5a-bc9f-077380774e99,created_at=2026-11-01T08:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-741292282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fc5bc73-0dd4-4c5a-bc9f-077380774e99,host='devstack@QuobyteHD#QuobyteHD',id=787db324-e974-4335-b4c0-a35b96d8f256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8721a7b25de546aaa66deed9e6f681a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:05:51Z,use_quota=True,user_id='5b461ebeeda04f70b00d01921ce852c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e34d3d2-be67-4dda-a3e9-1621f1955008),volume_type_id=9e34d3d2-be67-4dda-a3e9-1621f1955008)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Creating volume 787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:05:50 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:05:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:51 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 1073741824 Nov 01 09:05:51 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:51 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 1073741824" returned: 0 in 0.464s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:51 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 Nov 01 09:05:51 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:51 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256" returned: 0 in 0.270s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981ac4d0-6ee1-4ffc-ae75-ce0956ed7811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787db324-e974-4335-b4c0-a35b96d8f256', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc43e2-ee2f-42d5-bfc1-e59cb548cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:05:51 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Volume volume-787db324-e974-4335-b4c0-a35b96d8f256 (787db324-e974-4335-b4c0-a35b96d8f256): created successfully Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc43e2-ee2f-42d5-bfc1-e59cb548cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:05:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Flow 'volume_create_manager' (5d0d393c-2af2-4d8a-8c0e-c883323f196b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:05:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e5f3f2f9-e829-4715-be69-02af5e7e52bd tempest-GroupSnapshotsTest-169053504 None] Created volume successfully. Nov 01 09:05:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] GroupSnapshot 60692014-f526-4cbb-a50f-7b36140da5ed: creating. Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Group snapshot 60692014-f526-4cbb-a50f-7b36140da5ed: creating. {{(pid=86770) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Creating offline snapshot 7348d9b9-8cd8-452a-ac1f-22c813c9c061 of volume 787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a3072-fd8a-4621-bfe1-fff0db243216]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:52 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 Nov 01 09:05:52 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:52 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256" returned: 0 in 0.368s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:52 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 1G Nov 01 09:05:52 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:53 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 1G" returned: 0 in 0.392s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787db324-e974-4335-b4c0-a35b96d8f256 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:53 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787db324-e974-4335-b4c0-a35b96d8f256 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 Nov 01 09:05:53 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:53 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787db324-e974-4335-b4c0-a35b96d8f256 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061" returned: 0 in 0.287s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:53 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:53 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 Nov 01 09:05:53 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:53 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061" returned: 0 in 0.251s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:53 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.info Nov 01 09:05:53 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:53 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.info" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:53 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:05:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:53 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.info Nov 01 09:05:53 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:54 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.info" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3ab15346-8cb7-4840-8c58-614404ffe7cf tempest-GroupSnapshotsTest-169053504 None] group_snapshot 60692014-f526-4cbb-a50f-7b36140da5ed: created successfully Nov 01 09:05:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] group_snapshot 60692014-f526-4cbb-a50f-7b36140da5ed: deleting Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] group_snapshot 60692014-f526-4cbb-a50f-7b36140da5ed: deleting {{(pid=86770) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-787db324-e974-4335-b4c0-a35b96d8f256" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-787db324-e974-4335-b4c0-a35b96d8f256" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-7348d9b9-8cd8-452a-ac1f-22c813c9c061" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-7348d9b9-8cd8-452a-ac1f-22c813c9c061" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Deleting offline snapshot 7348d9b9-8cd8-452a-ac1f-22c813c9c061 of volume 787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] snapshot_file for this snap is: volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a0dba9-6c1e-4c6b-be6e-033670f4616d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:54 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 Nov 01 09:05:54 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:55 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061" returned: 0 in 0.375s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787db324-e974-4335-b4c0-a35b96d8f256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b1bec-b07c-426e-9aba-6eca03c26ba0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:55 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 Nov 01 09:05:55 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:55 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256" returned: 0 in 0.348s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:55 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 Nov 01 09:05:55 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:55 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061" returned: 0 in 0.328s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:55 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061 Nov 01 09:05:55 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:56 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256.7348d9b9-8cd8-452a-ac1f-22c813c9c061" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-7348d9b9-8cd8-452a-ac1f-22c813c9c061" released by "_delete_snapshot" :: held 1.414s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-787db324-e974-4335-b4c0-a35b96d8f256" released by "delete_snapshot" :: held 1.438s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:56 devstack cinder-volume[86770]: WARNING cinder.quota [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1326304098 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1326304098, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:56 devstack cinder-volume[86770]: WARNING cinder.quota [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1326304098 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1326304098, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:56 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] Created reservations ['c0a0de28-f2db-4d99-9f95-f78e40794a38', '1240f759-3daa-4d68-84a8-52e9200f3f4a', '2a991aa8-eebd-4fe0-86a1-9b976b61f3d7', 'e5a640c1-64af-48d8-8c05-347844b0b693'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-960bd4f5-480c-4997-8c3b-3eb6f6c5fcdf tempest-GroupSnapshotsTest-169053504 None] group_snapshot 60692014-f526-4cbb-a50f-7b36140da5ed: deleted successfully Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "cinder-quobyte-787db324-e974-4335-b4c0-a35b96d8f256" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-787db324-e974-4335-b4c0-a35b96d8f256" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fb91b8-ac76-434f-92bd-65cdf3a241a4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:57 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 Nov 01 09:05:57 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:57 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256" returned: 0 in 0.368s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:57 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256 Nov 01 09:05:57 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:57 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-787db324-e974-4335-b4c0-a35b96d8f256" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Lock "cinder-quobyte-787db324-e974-4335-b4c0-a35b96d8f256" released by "delete_volume" :: held 0.675s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['5f63545a-e5b9-40f4-955f-e5efecfc60df'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:57 devstack cinder-volume[86770]: WARNING cinder.quota [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1326304098 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1326304098, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:05:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Created reservations ['64e9af95-d186-4047-b36d-8cde40487b37', '0869cd23-eedd-475f-bee1-735e23ab82dc', '6b4a0b99-b580-4fca-9140-8f0761476ecc', '5540333e-1eac-49bb-b5f0-4a2713a8a81a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:05:58 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:05:58 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:05:58 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.248s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:05:58 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:05:58 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4b42e5ec-ef48-451a-aa71-4698ba758858 tempest-GroupSnapshotsTest-169053504 None] Delete group completed successfully. Nov 01 09:06:08 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=42,cinder:SELECT=34,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:06:08 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=47,cinder:SELECT=42,cinder:INSERT=8 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Flow 'volume_create_manager' (82837c9e-ea7d-424f-98b5-4e568643c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28648288-74a9-4ba4-9ed7-80d3939c1167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28648288-74a9-4ba4-9ed7-80d3939c1167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1522082826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce463fd-2fc0-4867-a082-7de4cdabb0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3c18691c714917b813f52085f08481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:20Z,use_quota=True,user_id='aca019150b894c90bd57530d7aabd5c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a803db38-977e-44e4-952a-87a2fbe67cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a803db38-977e-44e4-952a-87a2fbe67cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9d1e58-a57d-4d00-a83d-9220cb2ceb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9d1e58-a57d-4d00-a83d-9220cb2ceb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce463fd-2fc0-4867-a082-7de4cdabb0d8', 'volume_name': 'volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e05ff0-f872-4b77-94bd-ae4a46efe356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e05ff0-f872-4b77-94bd-ae4a46efe356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330efd32-2a04-455e-a761-29177e8bfcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:20 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Volume 1ce463fd-2fc0-4867-a082-7de4cdabb0d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8', 'volume_size': 1} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1522082826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce463fd-2fc0-4867-a082-7de4cdabb0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3c18691c714917b813f52085f08481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:20Z,use_quota=True,user_id='aca019150b894c90bd57530d7aabd5c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Creating volume 1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:06:20 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:20 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 1073741824 Nov 01 09:06:20 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:20 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 1073741824" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:20 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 Nov 01 09:06:20 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:21 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" returned: 0 in 0.258s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330efd32-2a04-455e-a761-29177e8bfcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f6a28a-6720-4772-98c7-ac3fbb20d65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:21 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Volume volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 (1ce463fd-2fc0-4867-a082-7de4cdabb0d8): created successfully Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f6a28a-6720-4772-98c7-ac3fbb20d65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Flow 'volume_create_manager' (82837c9e-ea7d-424f-98b5-4e568643c532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:21 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0b8cbb33-afc7-4c06-8abb-723b1e22a3a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Created volume successfully. Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:21 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:06:21 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Creating offline snapshot 05a0e034-30a0-414f-b33a-e8a76f95d15b of volume 1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f5f85-7f25-4b31-8cc0-a71b6b63325b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:21 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 Nov 01 09:06:21 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:21 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.288s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:06:21 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" returned: 0 in 0.391s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:21 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b 1G Nov 01 09:06:21 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:22 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b 1G" returned: 0 in 0.456s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:22 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b Nov 01 09:06:22 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:22 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b" returned: 0 in 0.301s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:22 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b is being set with open permissions: ugo+rw Nov 01 09:06:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:22 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b Nov 01 09:06:22 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:22 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:22 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.info Nov 01 09:06:22 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:23 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.info" returned: 0 in 0.268s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:23 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.info is being set with open permissions: ugo+rw Nov 01 09:06:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:23 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.info Nov 01 09:06:23 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:23 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.info" returned: 0 in 0.255s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e6dce732-a410-4d39-8b5b-f9d24e40f60f tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Create snapshot completed successfully Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "cinder-05a0e034-30a0-414f-b33a-e8a76f95d15b-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-05a0e034-30a0-414f-b33a-e8a76f95d15b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "cinder-quobyte-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-quobyte-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "cinder-quobyte-05a0e034-30a0-414f-b33a-e8a76f95d15b" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-quobyte-05a0e034-30a0-414f-b33a-e8a76f95d15b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Deleting offline snapshot 05a0e034-30a0-414f-b33a-e8a76f95d15b of volume 1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] snapshot_file for this snap is: volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea54d2b-64a0-44b9-ab20-40aa6b08e426]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:25 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b Nov 01 09:06:25 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:25 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b" returned: 0 in 0.392s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7888b4-ffd6-4595-881e-a9eed24f5b19]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:25 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 Nov 01 09:06:25 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:25 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:25 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b Nov 01 09:06:25 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:26 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b" returned: 0 in 0.350s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:26 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b Nov 01 09:06:26 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:26 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8.05a0e034-30a0-414f-b33a-e8a76f95d15b" returned: 0 in 0.284s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-quobyte-05a0e034-30a0-414f-b33a-e8a76f95d15b" released by "_delete_snapshot" :: held 1.527s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-quobyte-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" released by "delete_snapshot" :: held 1.551s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:26 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Created reservations ['a6b4865d-2477-4765-8970-71a9a3c5bcb6', '913c56d6-0665-44c9-acc8-5548ba50a828', 'be4475dc-4ec2-4e9a-a4d2-36d64f7c79c2', 'cc461483-2429-4bd9-afc9-4324d22ff1d4'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:06:26 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Delete snapshot completed successfully. Nov 01 09:06:26 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-97d20dcf-17ff-4203-8251-e29626488e6e tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-05a0e034-30a0-414f-b33a-e8a76f95d15b-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "cinder-1ce463fd-2fc0-4867-a082-7de4cdabb0d8-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-1ce463fd-2fc0-4867-a082-7de4cdabb0d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "cinder-quobyte-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-quobyte-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58dd216-cc6d-4c15-a231-7bab68db69d4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:27 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 Nov 01 09:06:27 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:27 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" returned: 0 in 0.360s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:27 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8 Nov 01 09:06:27 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:28 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-quobyte-1ce463fd-2fc0-4867-a082-7de4cdabb0d8" released by "delete_volume" :: held 0.677s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Created reservations ['0bf3895b-7e84-4ae5-85e8-d4e58a84ada3', 'f13f95c6-acd5-4983-b457-f6d57a59e314', 'cb08f142-22f6-4be4-8df3-df9609ebdc88', '129bfed9-504b-482f-be33-7ed2eeafff4f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:28 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:06:28 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:28 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:06:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Deleted volume successfully. Nov 01 09:06:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-18855a16-74f6-474b-84a2-1cd5a833a33c tempest-VolumeSnapshotQuotasNegativeTestJSON-453229531 None] Lock "cinder-1ce463fd-2fc0-4867-a082-7de4cdabb0d8-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=14,cinder:UPDATE=20,cinder:INSERT=7 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:06:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=16,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Flow 'volume_create_manager' (7f4f40d3-42f5-4309-851e-1e70ed389de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18996e20-cf4e-465c-a3f4-97cf2907fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18996e20-cf4e-465c-a3f4-97cf2907fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1788854261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6249ee-8a7d-4f46-89bb-2083455e8776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1811c0a029a945caa1de073c32ba9d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:40Z,use_quota=True,user_id='f235fd73a58a48f0b33bedce27719d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5748ab-5b53-4f89-8d27-3c624f80d908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5748ab-5b53-4f89-8d27-3c624f80d908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455541e7-0a36-46af-b061-455623258a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455541e7-0a36-46af-b061-455623258a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6249ee-8a7d-4f46-89bb-2083455e8776', 'volume_name': 'volume-5a6249ee-8a7d-4f46-89bb-2083455e8776', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54fff44-a597-43a5-a95d-6c567e9c2e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54fff44-a597-43a5-a95d-6c567e9c2e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b937e65d-d452-44f8-b959-5a10c9422de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:40 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Volume 5a6249ee-8a7d-4f46-89bb-2083455e8776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6249ee-8a7d-4f46-89bb-2083455e8776', 'volume_size': 1} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1788854261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6249ee-8a7d-4f46-89bb-2083455e8776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1811c0a029a945caa1de073c32ba9d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:40Z,use_quota=True,user_id='f235fd73a58a48f0b33bedce27719d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Creating volume 5a6249ee-8a7d-4f46-89bb-2083455e8776 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:06:40 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:06:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:40 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 1073741824 Nov 01 09:06:40 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:41 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 1073741824" returned: 0 in 0.421s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:41 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 Nov 01 09:06:41 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:41 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b937e65d-d452-44f8-b959-5a10c9422de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6249ee-8a7d-4f46-89bb-2083455e8776', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19143b83-da89-429e-8cb2-75d0e13ef00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:41 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Volume volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 (5a6249ee-8a7d-4f46-89bb-2083455e8776): created successfully Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19143b83-da89-429e-8cb2-75d0e13ef00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Flow 'volume_create_manager' (7f4f40d3-42f5-4309-851e-1e70ed389de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fddf3c36-cca0-4d4b-86d5-4e39cd848645 tempest-AbsoluteLimitsTests-1558316042 None] Created volume successfully. Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Acquiring lock "cinder-5a6249ee-8a7d-4f46-89bb-2083455e8776-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Lock "cinder-5a6249ee-8a7d-4f46-89bb-2083455e8776-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Acquiring lock "cinder-quobyte-5a6249ee-8a7d-4f46-89bb-2083455e8776" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Lock "cinder-quobyte-5a6249ee-8a7d-4f46-89bb-2083455e8776" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[584b0f19-a938-46dc-8ae6-fcffde9d5ed6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:06:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:41 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 Nov 01 09:06:41 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:42 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:42 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776 Nov 01 09:06:42 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:42 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6249ee-8a7d-4f46-89bb-2083455e8776" returned: 0 in 0.277s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Lock "cinder-quobyte-5a6249ee-8a7d-4f46-89bb-2083455e8776" released by "delete_volume" :: held 0.701s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Created reservations ['aaf82aa9-8dd2-48db-9a45-30779d7078aa', 'f7d71954-5b04-48ae-9022-155b3cab6288', 'f539990a-861c-493f-97a7-e9d2a82cf497', '44d0bc3f-bffc-44a8-a3be-61611ed11682'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:42 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:06:42 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:42 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.272s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:06:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Deleted volume successfully. Nov 01 09:06:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b6ab77e-1b7d-4e90-bb20-2354f23d3403 tempest-AbsoluteLimitsTests-1558316042 None] Lock "cinder-5a6249ee-8a7d-4f46-89bb-2083455e8776-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Flow 'volume_create_manager' (e6b33206-0b50-4bb5-8984-ae4424fd5f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f545a432-2809-45fe-ad86-0e596f953240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f545a432-2809-45fe-ad86-0e596f953240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1431551876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897b1fbe-0b73-4f26-9adb-3009a0ec0d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47884c983090488bbaea3a49dc971393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:49Z,use_quota=True,user_id='3f128a20886a4a4b88faf74f3639e850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f289933-58b2-4e5e-83e8-aef9f54523bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f289933-58b2-4e5e-83e8-aef9f54523bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49317539-e93b-4adc-8dd5-d2b0831a7233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49317539-e93b-4adc-8dd5-d2b0831a7233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897b1fbe-0b73-4f26-9adb-3009a0ec0d10', 'volume_name': 'volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e5169d-bc8b-43bb-a3d7-86c3d22e55f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e5169d-bc8b-43bb-a3d7-86c3d22e55f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074b4b2f-f7ca-43de-8a3a-2dfce716d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:48 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Volume 897b1fbe-0b73-4f26-9adb-3009a0ec0d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10', 'volume_size': 1} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1431551876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897b1fbe-0b73-4f26-9adb-3009a0ec0d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47884c983090488bbaea3a49dc971393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:49Z,use_quota=True,user_id='3f128a20886a4a4b88faf74f3639e850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Creating volume 897b1fbe-0b73-4f26-9adb-3009a0ec0d10 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:06:48 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:06:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:48 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 1073741824 Nov 01 09:06:48 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:49 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 1073741824" returned: 0 in 0.433s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:49 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 Nov 01 09:06:49 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:49 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10" returned: 0 in 0.253s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074b4b2f-f7ca-43de-8a3a-2dfce716d693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a137ef-3991-437e-8747-d0d4cdfcb71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Volume volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 (897b1fbe-0b73-4f26-9adb-3009a0ec0d10): created successfully Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a137ef-3991-437e-8747-d0d4cdfcb71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Flow 'volume_create_manager' (e6b33206-0b50-4bb5-8984-ae4424fd5f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4b7293bb-a210-46e5-839b-971e33a1f85c tempest-VolumesTransfersTest-5063722 None] Created volume successfully. Nov 01 09:06:50 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9302801c-350e-475a-8957-f003d2e59b02 tempest-VolumesTransfersTest-1883494623 None] Transfer volume completed successfully. Nov 01 09:06:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Acquiring lock "cinder-897b1fbe-0b73-4f26-9adb-3009a0ec0d10-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Lock "cinder-897b1fbe-0b73-4f26-9adb-3009a0ec0d10-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Acquiring lock "cinder-quobyte-897b1fbe-0b73-4f26-9adb-3009a0ec0d10" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Lock "cinder-quobyte-897b1fbe-0b73-4f26-9adb-3009a0ec0d10" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9cf9d-0628-409a-8857-7651574d77f6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:06:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:51 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 Nov 01 09:06:51 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:51 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10" returned: 0 in 0.355s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:51 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10 Nov 01 09:06:51 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:51 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-897b1fbe-0b73-4f26-9adb-3009a0ec0d10" returned: 0 in 0.241s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Lock "cinder-quobyte-897b1fbe-0b73-4f26-9adb-3009a0ec0d10" released by "delete_volume" :: held 0.635s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Created reservations ['af93b721-6fdc-4065-8802-b0f737297260', '6fe65bee-94d0-4399-8ccc-c60f9c4e4cf4', 'fc1bb8c0-b803-4dda-a965-5968f0fe9231', '7ac937f0-f449-466c-a673-921802a0d67f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:51 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:06:51 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:51 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:06:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Deleted volume successfully. Nov 01 09:06:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0f8cb561-31b8-4edf-8839-ca8d1838ebc2 tempest-VolumesTransfersTest-282761741 None] Lock "cinder-897b1fbe-0b73-4f26-9adb-3009a0ec0d10-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Flow 'volume_create_manager' (73674a7f-0f4a-492a-831d-1555a8da8f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b38cdcb-1997-4c8d-8ed9-8550548db260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b38cdcb-1997-4c8d-8ed9-8550548db260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1546850723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7d284e-fd4d-435c-9b67-1391b5534a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47884c983090488bbaea3a49dc971393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:52Z,use_quota=True,user_id='3f128a20886a4a4b88faf74f3639e850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1242fac0-a361-4019-8651-f7e0b5920aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1242fac0-a361-4019-8651-f7e0b5920aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc3c239-0b80-48b8-97e3-67b36d86ca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc3c239-0b80-48b8-97e3-67b36d86ca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7d284e-fd4d-435c-9b67-1391b5534a9d', 'volume_name': 'volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b183c-3664-4621-8bf7-20a5da32ad74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b183c-3664-4621-8bf7-20a5da32ad74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f223b9a7-58df-4c03-8c7f-4542a491043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:52 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Volume bd7d284e-fd4d-435c-9b67-1391b5534a9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d', 'volume_size': 1} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1546850723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7d284e-fd4d-435c-9b67-1391b5534a9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47884c983090488bbaea3a49dc971393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:06:52Z,use_quota=True,user_id='3f128a20886a4a4b88faf74f3639e850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Creating volume bd7d284e-fd4d-435c-9b67-1391b5534a9d {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:06:52 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:06:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:52 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d 1073741824 Nov 01 09:06:52 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:53 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d 1073741824" returned: 0 in 0.422s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:53 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d Nov 01 09:06:53 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:53 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d" returned: 0 in 0.270s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f223b9a7-58df-4c03-8c7f-4542a491043f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7fb188-184d-46e2-a97d-f8a280ef8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:06:53 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Volume volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d (bd7d284e-fd4d-435c-9b67-1391b5534a9d): created successfully Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7fb188-184d-46e2-a97d-f8a280ef8603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Flow 'volume_create_manager' (73674a7f-0f4a-492a-831d-1555a8da8f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:06:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-16b4398d-25f3-4add-98d7-c2da1f738934 tempest-VolumesTransfersTest-5063722 None] Created volume successfully. Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Acquiring lock "cinder-bd7d284e-fd4d-435c-9b67-1391b5534a9d-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Lock "cinder-bd7d284e-fd4d-435c-9b67-1391b5534a9d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Acquiring lock "cinder-quobyte-bd7d284e-fd4d-435c-9b67-1391b5534a9d" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Lock "cinder-quobyte-bd7d284e-fd4d-435c-9b67-1391b5534a9d" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e7c8ac-1bcf-4239-9d8e-61471442ebd9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:06:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:54 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d Nov 01 09:06:54 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:54 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:54 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d Nov 01 09:06:54 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:54 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-bd7d284e-fd4d-435c-9b67-1391b5534a9d" returned: 0 in 0.243s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Lock "cinder-quobyte-bd7d284e-fd4d-435c-9b67-1391b5534a9d" released by "delete_volume" :: held 0.646s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Created reservations ['87d956cb-a405-4901-94df-1b998fcf0aaf', '4aa79a64-b729-4844-b4dc-4b618ae53350', 'd1ddd879-d394-483d-95b3-f7a4d987aa74', 'e06bc575-e96e-4669-b14b-dccf12d5a4d8'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:06:54 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:06:54 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:06:54 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:06:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Deleted volume successfully. Nov 01 09:06:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-67997e6f-4dc5-40f9-b667-33d2e239c18d tempest-VolumesTransfersTest-282761741 None] Lock "cinder-bd7d284e-fd4d-435c-9b67-1391b5534a9d-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:07:04 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=33,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:07:04 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Flow 'volume_create_manager' (5b0b8f9b-09e8-464b-873f-a06839a4c8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a35185-e716-4e44-b1ba-ae82ad5d9d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a35185-e716-4e44-b1ba-ae82ad5d9d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-338786580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da478d98-76c7-4dfa-a394-5fc0621c9254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4777bd907bd484f9926e5fd0f4e7926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:07:08Z,use_quota=True,user_id='62a345c8cd234894b4e98efbcee0b8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602cd648-5e58-4fa6-80d0-976b5a165b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602cd648-5e58-4fa6-80d0-976b5a165b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac1d646-f098-4181-b94e-f9d0646a5a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac1d646-f098-4181-b94e-f9d0646a5a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da478d98-76c7-4dfa-a394-5fc0621c9254', 'volume_name': 'volume-da478d98-76c7-4dfa-a394-5fc0621c9254', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e86ecd-00cb-4de3-8883-1a21399187b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e86ecd-00cb-4de3-8883-1a21399187b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08611ef0-5620-448d-8cf2-02fb3c3e6ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:07:08 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Volume da478d98-76c7-4dfa-a394-5fc0621c9254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da478d98-76c7-4dfa-a394-5fc0621c9254', 'volume_size': 1} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-338786580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da478d98-76c7-4dfa-a394-5fc0621c9254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4777bd907bd484f9926e5fd0f4e7926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:07:08Z,use_quota=True,user_id='62a345c8cd234894b4e98efbcee0b8e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Creating volume da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:07:08 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:08 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 1073741824 Nov 01 09:07:08 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:08 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 1073741824" returned: 0 in 0.402s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:09 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:07:09 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:09 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08611ef0-5620-448d-8cf2-02fb3c3e6ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da478d98-76c7-4dfa-a394-5fc0621c9254', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29b7b3a-ea51-4673-b3a2-1070d48b761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:07:09 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Volume volume-da478d98-76c7-4dfa-a394-5fc0621c9254 (da478d98-76c7-4dfa-a394-5fc0621c9254): created successfully Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29b7b3a-ea51-4673-b3a2-1070d48b761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:07:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Flow 'volume_create_manager' (5b0b8f9b-09e8-464b-873f-a06839a4c8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:07:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ca7c8f53-360e-4aa7-97d0-9abeb5559a54 tempest-VolumesActionsTest-496608912 None] Created volume successfully. Nov 01 09:07:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9e3624d-1b4a-4548-8f7b-43a183565421 tempest-VolumesActionsTest-496608912 None] Acquiring lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254" by "attach_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:07:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9e3624d-1b4a-4548-8f7b-43a183565421 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254" acquired by "attach_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:07:16 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c9e3624d-1b4a-4548-8f7b-43a183565421 tempest-VolumesActionsTest-496608912 None] Attaching volume da478d98-76c7-4dfa-a394-5fc0621c9254 to instance 58b00a78-9357-40b1-aae5-60f78e0be1d5 at mountpoint /dev/vdb on host None. Nov 01 09:07:16 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c9e3624d-1b4a-4548-8f7b-43a183565421 tempest-VolumesActionsTest-496608912 None] Attach volume completed successfully. Nov 01 09:07:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9e3624d-1b4a-4548-8f7b-43a183565421 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254" released by "attach_volume" :: held 0.091s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:07:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4e166edc-6b18-4b85-8deb-63441c34bca3 tempest-VolumesActionsTest-496608912 None] Acquiring lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-detach_volume" by "detach_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:07:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4e166edc-6b18-4b85-8deb-63441c34bca3 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:07:16 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4e166edc-6b18-4b85-8deb-63441c34bca3 tempest-VolumesActionsTest-496608912 None] Detaching volume da478d98-76c7-4dfa-a394-5fc0621c9254 from instance 58b00a78-9357-40b1-aae5-60f78e0be1d5. Nov 01 09:07:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4e166edc-6b18-4b85-8deb-63441c34bca3 tempest-VolumesActionsTest-496608912 None] Detach volume completed successfully. Nov 01 09:07:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4e166edc-6b18-4b85-8deb-63441c34bca3 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:21 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:07:21 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:21 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.310s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:07:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d3a861e-c143-4a89-8c66-a2a28393238c tempest-VolumesActionsTest-496608912 None] Acquiring lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254" by "attach_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d3a861e-c143-4a89-8c66-a2a28393238c tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254" acquired by "attach_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:07:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1d3a861e-c143-4a89-8c66-a2a28393238c tempest-VolumesActionsTest-496608912 None] Attaching volume da478d98-76c7-4dfa-a394-5fc0621c9254 to instance b56f24c4-c9c8-4df9-a3cd-7ec1f99240f2 at mountpoint /dev/vdb on host None. Nov 01 09:07:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1d3a861e-c143-4a89-8c66-a2a28393238c tempest-VolumesActionsTest-496608912 None] Attach volume completed successfully. Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1d3a861e-c143-4a89-8c66-a2a28393238c tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254" released by "attach_volume" :: held 0.093s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd70eeb8-db17-417a-aa93-2e08e41cb175 tempest-VolumesActionsTest-496608912 None] Acquiring lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-detach_volume" by "detach_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd70eeb8-db17-417a-aa93-2e08e41cb175 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:07:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cd70eeb8-db17-417a-aa93-2e08e41cb175 tempest-VolumesActionsTest-496608912 None] Detaching volume da478d98-76c7-4dfa-a394-5fc0621c9254 from instance b56f24c4-c9c8-4df9-a3cd-7ec1f99240f2. Nov 01 09:07:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cd70eeb8-db17-417a-aa93-2e08e41cb175 tempest-VolumesActionsTest-496608912 None] Detach volume completed successfully. Nov 01 09:07:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd70eeb8-db17-417a-aa93-2e08e41cb175 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:07:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:07:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:07:31 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[60767529-ec07-4f59-ab73-be607f04470d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:07:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:31 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:07:31 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:32 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b6941-3480-45c6-82b8-81c0121ca84c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:07:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:32 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:07:32 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:32 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.fe9fdcb4-1db9-4f54-8c71-c31d06615ba5zwv4okwr.img {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:32 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.fe9fdcb4-1db9-4f54-8c71-c31d06615ba5zwv4okwr.img Nov 01 09:07:32 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:37 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:07:38 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.fe9fdcb4-1db9-4f54-8c71-c31d06615ba5zwv4okwr.img" returned: 0 in 5.665s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:38 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4effdc-0896-408f-b32b-3d77b6932bb2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:07:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:38 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:07:38 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:38 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.546s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:38 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.fe9fdcb4-1db9-4f54-8c71-c31d06615ba5zwv4okwr.img {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:07:38 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Converted 1024.00 MB image at 180.74 MB/s Nov 01 09:07:38 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] fe9fdcb4-1db9-4f54-8c71-c31d06615ba5 was raw, no need to convert to raw {{(pid=86770) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 09:07:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:INSERT=2,cinder:SELECT=9,cinder:UPDATE=3 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:07:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:07:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.332s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:07:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Uploaded volume to glance image-id: fe9fdcb4-1db9-4f54-8c71-c31d06615ba5. {{(pid=86770) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 09:07:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0d5dff3d-4e6a-4ade-95ba-488c2b2ef627 tempest-VolumesActionsTest-496608912 None] Copy volume to image completed successfully. Nov 01 09:07:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:07:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:07:58 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9950254-2728-47e4-9898-8d872c0b49b2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:07:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:58 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:07:58 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:58 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.377s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:58 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8281e5d2-8a3c-4fb7-860a-c433300a01dc]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:07:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:58 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:07:58 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:07:59 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Nov 01 09:07:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:07:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:07:59 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img Nov 01 09:07:59 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:05 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img" returned: 0 in 5.969s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[024be6b3-cd52-4ad4-874b-2fdac93c665c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:05 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:08:05 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:05 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.527s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:08:05 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Converted 1024.00 MB image at 171.53 MB/s Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] 67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6 was raw, converting to qcow2 {{(pid=86770) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef80f9-8226-4a05-976f-36a98fa40462]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:05 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img Nov 01 09:08:05 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:06 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img" returned: 0 in 0.329s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:06 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img Nov 01 09:08:06 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:06 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img" returned: 1 in 0.325s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img /opt/stack/data/cinder/conversion/vol_upload_roav8fbr {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:06 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img /opt/stack/data/cinder/conversion/vol_upload_roav8fbr Nov 01 09:08:06 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:06 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img /opt/stack/data/cinder/conversion/vol_upload_roav8fbr" returned: 0 in 0.268s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Image conversion details: src /opt/stack/data/cinder/conversion/da478d98-76c7-4dfa-a394-5fc0621c9254.temp_image.67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6plnq97y7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_roav8fbr {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:08:06 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b62be2-fd30-4bd8-9b4b-8c57e8a4610d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_roav8fbr {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:06 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_roav8fbr Nov 01 09:08:06 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:06 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_roav8fbr" returned: 0 in 0.330s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.869s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Uploaded volume to glance image-id: 67cc1996-7c02-4e5c-8703-3f5e0f1a4bd6. {{(pid=86770) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 09:08:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-842d1e3b-b954-4958-99c0-df1d512d14e0 tempest-VolumesActionsTest-496608912 None] Copy volume to image completed successfully. Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Acquiring lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Acquiring lock "cinder-quobyte-da478d98-76c7-4dfa-a394-5fc0621c9254" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Lock "cinder-quobyte-da478d98-76c7-4dfa-a394-5fc0621c9254" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2f3575-e727-4d70-8f09-08d59b93326f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:09 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:08:09 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:09 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.363s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:10 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254 Nov 01 09:08:10 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:10 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-da478d98-76c7-4dfa-a394-5fc0621c9254" returned: 0 in 0.246s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Lock "cinder-quobyte-da478d98-76c7-4dfa-a394-5fc0621c9254" released by "delete_volume" :: held 0.647s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Created reservations ['1c2b5059-498b-4edb-847f-8d46be68accc', '0d5dd8eb-312e-48d1-97ac-5c14f66d8bd6', '60e293c4-ef45-4425-8831-8b76e3b61256', 'eb49fa01-d3c4-4076-9aae-1ed325d4cde3'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:10 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:10 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:10 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.237s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Deleted volume successfully. Nov 01 09:08:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3a3d2737-935f-4494-8572-ba7766ec4aa0 tempest-VolumesActionsTest-496608912 None] Lock "cinder-da478d98-76c7-4dfa-a394-5fc0621c9254-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (dc871fa6-06f6-4bcf-af80-21e06f6ea6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfa7936-07a4-4979-aae3-3e940be0912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfa7936-07a4-4979-aae3-3e940be0912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19226166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa850a0f-e8e4-4345-9e5b-2d5784815fa9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:18Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6050c3f-23e2-4937-99d9-b1e1cc3d067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6050c3f-23e2-4937-99d9-b1e1cc3d067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8790a7b9-23bb-4ecf-8961-f0f5b42b7ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8790a7b9-23bb-4ecf-8961-f0f5b42b7ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa850a0f-e8e4-4345-9e5b-2d5784815fa9', 'volume_name': 'volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd801af8-bfe2-41e4-8c1f-5ff13da7ee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd801af8-bfe2-41e4-8c1f-5ff13da7ee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21f8e34-7aae-4e68-8012-846cc740c074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:18 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Volume fa850a0f-e8e4-4345-9e5b-2d5784815fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9', 'volume_size': 1} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19226166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa850a0f-e8e4-4345-9e5b-2d5784815fa9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:18Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Creating volume fa850a0f-e8e4-4345-9e5b-2d5784815fa9 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:08:18 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:18 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 1073741824 Nov 01 09:08:18 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:18 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 1073741824" returned: 0 in 0.419s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:18 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 Nov 01 09:08:18 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:19 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21f8e34-7aae-4e68-8012-846cc740c074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8773ac18-0c1a-4b01-b503-e39d55b14e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:19 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Volume volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 (fa850a0f-e8e4-4345-9e5b-2d5784815fa9): created successfully Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8773ac18-0c1a-4b01-b503-e39d55b14e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (dc871fa6-06f6-4bcf-af80-21e06f6ea6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1e4616c8-560e-4d8e-9048-d676d7a287ed tempest-VolumesGetTest-200660877 None] Created volume successfully. Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (db992567-d046-4765-9cde-c8e1afbd9865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:19 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d3aef-fc2a-4cb1-835e-d86ba2e023b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d3aef-fc2a-4cb1-835e-d86ba2e023b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1273779084',display_name='tempest-VolumesGetTest-Volume-733911491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694bd3da-7da6-483b-930b-b156da19a472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:20Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8676e72c-71a3-4a40-ad04-89c3b9d866eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8676e72c-71a3-4a40-ad04-89c3b9d866eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e2f8d-67d6-4b2f-a29d-5a1369c53992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189e2f8d-67d6-4b2f-a29d-5a1369c53992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694bd3da-7da6-483b-930b-b156da19a472', 'volume_name': 'volume-694bd3da-7da6-483b-930b-b156da19a472', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb0a3a8-b4a9-4acb-a760-55ee14adac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb0a3a8-b4a9-4acb-a760-55ee14adac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986f5b61-0a8c-4fb5-b804-3996ef113fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:20 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Volume 694bd3da-7da6-483b-930b-b156da19a472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694bd3da-7da6-483b-930b-b156da19a472', 'volume_size': 1} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1273779084',display_name='tempest-VolumesGetTest-Volume-733911491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694bd3da-7da6-483b-930b-b156da19a472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:20Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Creating volume 694bd3da-7da6-483b-930b-b156da19a472 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:08:20 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:20 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 1073741824 Nov 01 09:08:20 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:20 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 1073741824" returned: 0 in 0.414s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:20 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 Nov 01 09:08:20 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:20 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472" returned: 0 in 0.243s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986f5b61-0a8c-4fb5-b804-3996ef113fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694bd3da-7da6-483b-930b-b156da19a472', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ab203e-e716-4686-a1ed-029b0ab15240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:20 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Volume volume-694bd3da-7da6-483b-930b-b156da19a472 (694bd3da-7da6-483b-930b-b156da19a472): created successfully Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ab203e-e716-4686-a1ed-029b0ab15240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:20 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (db992567-d046-4765-9cde-c8e1afbd9865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2c9a23ac-bcb2-481b-8b62-3145b09c7100 tempest-VolumesGetTest-200660877 None] Created volume successfully. Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-694bd3da-7da6-483b-930b-b156da19a472-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Lock "cinder-694bd3da-7da6-483b-930b-b156da19a472-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-694bd3da-7da6-483b-930b-b156da19a472" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-694bd3da-7da6-483b-930b-b156da19a472" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2ef8e1-b946-45b2-8177-2f83202ff71e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:21 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 Nov 01 09:08:21 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:21 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:21 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:21 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472" returned: 0 in 0.399s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:21 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472 Nov 01 09:08:21 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:21 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.288s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:08:21 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-694bd3da-7da6-483b-930b-b156da19a472" returned: 0 in 0.248s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-694bd3da-7da6-483b-930b-b156da19a472" released by "delete_volume" :: held 0.692s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Created reservations ['9a7cf1d0-9678-472c-9c52-348113c3fcd3', 'b4ec15c7-2e98-4e08-92c5-b0e2786205de', 'e83f38ba-3da1-46d0-9297-a273907b20ce', 'e0930a92-d716-476e-b2de-efdae7615a23'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:22 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:22 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:22 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.260s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:22 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Deleted volume successfully. Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7bb6db2a-1d6d-4d74-b567-8f2c6d5fc7ab tempest-VolumesGetTest-200660877 None] Lock "cinder-694bd3da-7da6-483b-930b-b156da19a472-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-fa850a0f-e8e4-4345-9e5b-2d5784815fa9-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Lock "cinder-fa850a0f-e8e4-4345-9e5b-2d5784815fa9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-fa850a0f-e8e4-4345-9e5b-2d5784815fa9" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-fa850a0f-e8e4-4345-9e5b-2d5784815fa9" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[366b6f2d-33d8-4991-86f5-da7962828a85]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:22 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 Nov 01 09:08:22 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:22 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9" returned: 0 in 0.371s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:22 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9 Nov 01 09:08:22 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:23 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fa850a0f-e8e4-4345-9e5b-2d5784815fa9" returned: 0 in 0.241s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-fa850a0f-e8e4-4345-9e5b-2d5784815fa9" released by "delete_volume" :: held 0.658s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Created reservations ['d1abb4fb-a71e-425b-903d-ac4b1344e255', '4d3dbe5e-60a0-4c9f-9676-069a0b4fce9f', '771c1b42-9022-4d65-9f98-499a60d51927', '085f3de4-61ec-4db4-ae40-5d0e9c308106'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:23 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:23 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:23 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.246s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Deleted volume successfully. Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-082021c8-9c1d-49b5-9907-babcfd2ffd45 tempest-VolumesGetTest-200660877 None] Lock "cinder-fa850a0f-e8e4-4345-9e5b-2d5784815fa9-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (bf6555c1-13b5-4f2f-9f77-a0252b40f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabf7595-7065-4342-86e3-4cf05ac6b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabf7595-7065-4342-86e3-4cf05ac6b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-305545054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07021c0-6d6e-40f2-954f-7a504b20d475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:24Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771a9f73-bef5-46b5-b59d-199f6d2f1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771a9f73-bef5-46b5-b59d-199f6d2f1224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88d066f-470e-4660-b0eb-395fda45012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:23 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88d066f-470e-4660-b0eb-395fda45012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07021c0-6d6e-40f2-954f-7a504b20d475', 'volume_name': 'volume-e07021c0-6d6e-40f2-954f-7a504b20d475', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480088b6-da68-4d8f-a825-425930d3ec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480088b6-da68-4d8f-a825-425930d3ec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc0a8e7-6059-44e7-9bb9-7fc76a539fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Volume e07021c0-6d6e-40f2-954f-7a504b20d475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07021c0-6d6e-40f2-954f-7a504b20d475', 'volume_size': 1} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-305545054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e07021c0-6d6e-40f2-954f-7a504b20d475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:24Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Creating volume e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:08:24 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:24 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 1073741824 Nov 01 09:08:24 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:24 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 1073741824" returned: 0 in 0.403s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:24 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 Nov 01 09:08:24 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:24 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475" returned: 0 in 0.251s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc0a8e7-6059-44e7-9bb9-7fc76a539fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07021c0-6d6e-40f2-954f-7a504b20d475', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd174677-f84f-486d-a9e6-6b7e77b9e83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Volume volume-e07021c0-6d6e-40f2-954f-7a504b20d475 (e07021c0-6d6e-40f2-954f-7a504b20d475): created successfully Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd174677-f84f-486d-a9e6-6b7e77b9e83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (bf6555c1-13b5-4f2f-9f77-a0252b40f199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a77503b2-109a-4cd1-b1af-cdb221e42eb7 tempest-VolumesGetTest-200660877 None] Created volume successfully. Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (e1cc0efd-f49d-466e-a8ad-30c4e598a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d9010-79cd-42fa-b818-655552c0a0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d9010-79cd-42fa-b818-655552c0a0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1771464532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62f48cc-d06d-46aa-826b-2b8c3916be66,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e07021c0-6d6e-40f2-954f-7a504b20d475,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:25Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3163b460-51ec-418e-93ad-3fe42f847dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3163b460-51ec-418e-93ad-3fe42f847dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4327da8-8ada-4437-bb31-e8ee1151d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4327da8-8ada-4437-bb31-e8ee1151d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e62f48cc-d06d-46aa-826b-2b8c3916be66', 'volume_name': 'volume-e62f48cc-d06d-46aa-826b-2b8c3916be66', 'volume_size': 1, 'source_volid': 'e07021c0-6d6e-40f2-954f-7a504b20d475', 'source_volstatus': 'available'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdf5e8c-b99f-4957-9288-fd5663798d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cdf5e8c-b99f-4957-9288-fd5663798d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc8430e-4484-4d63-b00d-a9d22a755c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Volume e62f48cc-d06d-46aa-826b-2b8c3916be66: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e62f48cc-d06d-46aa-826b-2b8c3916be66', 'volume_size': 1, 'source_volid': 'e07021c0-6d6e-40f2-954f-7a504b20d475', 'source_volstatus': 'available'} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:25 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Cloning volume e07021c0-6d6e-40f2-954f-7a504b20d475 to volume e62f48cc-d06d-46aa-826b-2b8c3916be66 Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Creating offline snapshot 5f9b0161-91f6-449c-9f7d-554d145e7786 of volume e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[140c4ed9-021c-48c6-8b7b-c965a320fc92]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:25 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 Nov 01 09:08:25 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:26 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475" returned: 0 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:26 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 1G Nov 01 09:08:26 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:26 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 1G" returned: 0 in 0.396s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e07021c0-6d6e-40f2-954f-7a504b20d475 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:26 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e07021c0-6d6e-40f2-954f-7a504b20d475 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 Nov 01 09:08:26 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:26 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e07021c0-6d6e-40f2-954f-7a504b20d475 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786" returned: 0 in 0.273s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:26 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 is being set with open permissions: ugo+rw Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:26 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 Nov 01 09:08:26 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:26 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786" returned: 0 in 0.239s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:26 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.info Nov 01 09:08:26 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:27 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.info" returned: 0 in 0.245s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:27 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.info is being set with open permissions: ugo+rw Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:27 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.info Nov 01 09:08:27 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:27 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.info" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-e62f48cc-d06d-46aa-826b-2b8c3916be66" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-e62f48cc-d06d-46aa-826b-2b8c3916be66" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] snapshot: 5f9b0161-91f6-449c-9f7d-554d145e7786, volume: e62f48cc-d06d-46aa-826b-2b8c3916be66, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d327e3bd-9ce6-4765-a2de-7f4b14795edb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:27 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 Nov 01 09:08:27 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:27 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786" returned: 0 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e07021c0-6d6e-40f2-954f-7a504b20d475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8cac56-0789-4e06-a311-161984cfd5d0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:28 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 Nov 01 09:08:28 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:28 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475" returned: 0 in 0.343s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:08:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:08:28 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:08:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:28 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 Nov 01 09:08:28 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:34 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66" returned: 0 in 5.784s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:08:34 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Converted 1024.00 MB image at 176.99 MB/s Nov 01 09:08:34 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 is being set with open permissions: ugo+rw Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:34 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 Nov 01 09:08:34 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:34 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-e62f48cc-d06d-46aa-826b-2b8c3916be66" released by "_copy_volume_from_snapshot" :: held 6.814s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-5f9b0161-91f6-449c-9f7d-554d145e7786" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-5f9b0161-91f6-449c-9f7d-554d145e7786" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Deleting offline snapshot 5f9b0161-91f6-449c-9f7d-554d145e7786 of volume e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] snapshot_file for this snap is: volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5beabd-0de5-44ad-a94d-ec9fa4d8310b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:34 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 Nov 01 09:08:34 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:34 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786" returned: 0 in 0.347s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e07021c0-6d6e-40f2-954f-7a504b20d475(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b079e95-eed3-4bbd-953b-300e48abd82f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:34 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 Nov 01 09:08:34 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:35 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475" returned: 0 in 0.564s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:35 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 Nov 01 09:08:35 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:35 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:35 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786 Nov 01 09:08:35 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:35 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475.5f9b0161-91f6-449c-9f7d-554d145e7786" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-5f9b0161-91f6-449c-9f7d-554d145e7786" released by "_delete_snapshot" :: held 1.578s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.348s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc8430e-4484-4d63-b00d-a9d22a755c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62f48cc-d06d-46aa-826b-2b8c3916be66', 'volume_size': 1, 'source_volid': 'e07021c0-6d6e-40f2-954f-7a504b20d475', 'source_volstatus': 'available'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963b9687-15c1-416e-961b-12bef8696a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Volume volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 (e62f48cc-d06d-46aa-826b-2b8c3916be66): created successfully Nov 01 09:08:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963b9687-15c1-416e-961b-12bef8696a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (e1cc0efd-f49d-466e-a8ad-30c4e598a628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c82e6cee-1c68-453c-9e0a-12ad2c8493fa tempest-VolumesGetTest-200660877 None] Created volume successfully. Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (e8204791-fa67-454c-a44c-bab5f692b894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa44e1bc-2c85-4757-bf4d-2b34f903b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa44e1bc-2c85-4757-bf4d-2b34f903b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1475503176',display_name='tempest-VolumesGetTest-Volume-1854505093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f28b732-b008-468f-bea8-416a9dce5c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:37Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deb6ac6-6a6b-4f7f-8d77-7a34f776b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deb6ac6-6a6b-4f7f-8d77-7a34f776b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad109c53-c51c-4a51-ad64-b00b3b884db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad109c53-c51c-4a51-ad64-b00b3b884db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f28b732-b008-468f-bea8-416a9dce5c5e', 'volume_name': 'volume-7f28b732-b008-468f-bea8-416a9dce5c5e', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa257d6a-cb3c-4be4-8006-0500bde1b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa257d6a-cb3c-4be4-8006-0500bde1b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c13959b-6217-42bf-948f-362e03de6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Volume 7f28b732-b008-468f-bea8-416a9dce5c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f28b732-b008-468f-bea8-416a9dce5c5e', 'volume_size': 1} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1475503176',display_name='tempest-VolumesGetTest-Volume-1854505093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f28b732-b008-468f-bea8-416a9dce5c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:37Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Creating volume 7f28b732-b008-468f-bea8-416a9dce5c5e {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:08:36 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:08:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:36 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e 1073741824 Nov 01 09:08:36 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:37 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e 1073741824" returned: 0 in 0.411s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:37 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e Nov 01 09:08:37 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:37 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c13959b-6217-42bf-948f-362e03de6816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f28b732-b008-468f-bea8-416a9dce5c5e', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd61ea17-5092-4a3c-ad57-c77cfbaf506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:37 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Volume volume-7f28b732-b008-468f-bea8-416a9dce5c5e (7f28b732-b008-468f-bea8-416a9dce5c5e): created successfully Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd61ea17-5092-4a3c-ad57-c77cfbaf506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (e8204791-fa67-454c-a44c-bab5f692b894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-86efef1d-fb46-497e-b46c-a817d541a0cc tempest-VolumesGetTest-200660877 None] Created volume successfully. Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-7f28b732-b008-468f-bea8-416a9dce5c5e-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Lock "cinder-7f28b732-b008-468f-bea8-416a9dce5c5e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-7f28b732-b008-468f-bea8-416a9dce5c5e" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-7f28b732-b008-468f-bea8-416a9dce5c5e" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7254fa6b-abb9-4dd6-8e85-e814498ebff1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:38 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e Nov 01 09:08:38 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:38 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e" returned: 0 in 0.352s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:38 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e Nov 01 09:08:38 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:38 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7f28b732-b008-468f-bea8-416a9dce5c5e" returned: 0 in 0.259s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-7f28b732-b008-468f-bea8-416a9dce5c5e" released by "delete_volume" :: held 0.654s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Created reservations ['331994cc-0590-4044-bd4a-3895d9ef487a', 'f76f03be-1f7d-472d-bc7d-6d75dfc54ae5', '3749eeb9-fdc1-435d-8e69-3fdef5b04a2d', 'c1ef4cb4-830f-48fd-8092-122687943d26'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:38 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:38 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:39 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.263s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Deleted volume successfully. Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-16add254-9c9d-4fa5-b8da-8c37c888dde8 tempest-VolumesGetTest-200660877 None] Lock "cinder-7f28b732-b008-468f-bea8-416a9dce5c5e-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-e62f48cc-d06d-46aa-826b-2b8c3916be66-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Lock "cinder-e62f48cc-d06d-46aa-826b-2b8c3916be66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-e62f48cc-d06d-46aa-826b-2b8c3916be66" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-e62f48cc-d06d-46aa-826b-2b8c3916be66" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fdafc8-d22a-4296-b71d-aa963d19b557]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:39 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 Nov 01 09:08:39 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:39 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66" returned: 0 in 0.395s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:39 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66 Nov 01 09:08:39 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:40 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e62f48cc-d06d-46aa-826b-2b8c3916be66" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-e62f48cc-d06d-46aa-826b-2b8c3916be66" released by "delete_volume" :: held 0.698s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Created reservations ['c9945ae3-c7be-48c8-9593-0a41d5687157', 'c6723025-7671-4d42-b3e7-7e2d4ec64d1f', 'cd83d748-18dc-4671-bbf7-66bbb6db40a0', '54c4ff78-bb76-4f29-a5b8-7153861a66a3'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:40 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:40 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:40 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:40 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Deleted volume successfully. Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-79004526-a860-4ee4-b0c3-59eddefe2371 tempest-VolumesGetTest-200660877 None] Lock "cinder-e62f48cc-d06d-46aa-826b-2b8c3916be66-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-e07021c0-6d6e-40f2-954f-7a504b20d475-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Lock "cinder-e07021c0-6d6e-40f2-954f-7a504b20d475-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-e07021c0-6d6e-40f2-954f-7a504b20d475" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-e07021c0-6d6e-40f2-954f-7a504b20d475" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23a5def-0c60-49b7-b1fa-58cf359fbebe]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:40 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 Nov 01 09:08:40 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:41 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:41 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475 Nov 01 09:08:41 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:41 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e07021c0-6d6e-40f2-954f-7a504b20d475" returned: 0 in 0.253s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-e07021c0-6d6e-40f2-954f-7a504b20d475" released by "delete_volume" :: held 0.693s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Created reservations ['3c2b4e4e-254d-424a-a9f9-a538ad1aee25', 'e329b0b1-285a-4f15-853c-1b1bea1fdf81', '33676e57-d260-4c5f-bbf1-d22e6135cd61', 'f7f191a1-c0f1-4cdb-a7d0-2a7f206b85d1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:41 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:41 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:41 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Deleted volume successfully. Nov 01 09:08:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ba0097e-5854-427a-aa53-123b66775b80 tempest-VolumesGetTest-200660877 None] Lock "cinder-e07021c0-6d6e-40f2-954f-7a504b20d475-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (0e1ab4d5-0a86-4c8b-8180-369d6326b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4577edc2-0e0e-4723-b40e-45f1d552d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4577edc2-0e0e-4723-b40e-45f1d552d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-687050690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a3be05-96e5-42db-983b-c8509c4843a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:42Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae39f0d3-c10e-4611-8028-aaac5182d280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae39f0d3-c10e-4611-8028-aaac5182d280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce6f411-9825-47a8-81b5-be39b2bf3a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce6f411-9825-47a8-81b5-be39b2bf3a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1a3be05-96e5-42db-983b-c8509c4843a4', 'volume_name': 'volume-c1a3be05-96e5-42db-983b-c8509c4843a4', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c90b1c-fe13-4013-a3ee-4848c58c634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c90b1c-fe13-4013-a3ee-4848c58c634b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eb9e61-2ee8-4a49-9b3c-77f8ece101c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:42 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Volume c1a3be05-96e5-42db-983b-c8509c4843a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1a3be05-96e5-42db-983b-c8509c4843a4', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 09:08:42 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Trying to clone c1a3be05-96e5-42db-983b-c8509c4843a4 from image 2972c011-c2ff-40ad-8107-682efa81840b at location (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:08:43 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Image download 20.69 MB at 20.69 MB/s Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb279b-56ac-4f73-826b-f3c2b8942b9e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:43 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD Nov 01 09:08:43 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:43 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b is fetched for user a70c248ae5e94feaa022d065b6fcf11e. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeca290-7e7f-4ffe-9026-c336518b2e90]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:43 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD Nov 01 09:08:43 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:43 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-687050690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1a3be05-96e5-42db-983b-c8509c4843a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:42Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Creating volume c1a3be05-96e5-42db-983b-c8509c4843a4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:08:43 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:08:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:43 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 1073741824 Nov 01 09:08:43 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:44 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 1073741824" returned: 0 in 0.424s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:44 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 Nov 01 09:08:44 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:44 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4" returned: 0 in 0.252s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Attempting download of 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume c1a3be05-96e5-42db-983b-c8509c4843a4. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a687b4de-4d5f-4a9e-aef6-30b161b90ec8]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dn4jkmsu {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:44 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dn4jkmsu Nov 01 09:08:44 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:45 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dn4jkmsu" returned: 0 in 0.337s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dn4jkmsu {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:45 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dn4jkmsu Nov 01 09:08:45 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:45 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dn4jkmsu" returned: 1 in 0.324s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2972c011-c2ff-40ad-8107-682efa81840b_dn4jkmsu' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a5dd3a-9a1b-4bf9-8278-823bfd5b9f1e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:45 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD Nov 01 09:08:45 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:45 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] 2972c011-c2ff-40ad-8107-682efa81840b was qcow2, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:08:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:45 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 Nov 01 09:08:45 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:47 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4" returned: 0 in 1.782s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2972c011-c2ff-40ad-8107-682efa81840b_2wc5l_2mdevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:08:47 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Converted 112.00 MB image at 62.82 MB/s Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:47 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 1G Nov 01 09:08:47 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:47 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 1G" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Downloaded image 2972c011-c2ff-40ad-8107-682efa81840b ((None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}])) to volume c1a3be05-96e5-42db-983b-c8509c4843a4 successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Temporary image 2972c011-c2ff-40ad-8107-682efa81840b for user a70c248ae5e94feaa022d065b6fcf11e is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Marking volume c1a3be05-96e5-42db-983b-c8509c4843a4 as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Copying metadata from image 2972c011-c2ff-40ad-8107-682efa81840b to c1a3be05-96e5-42db-983b-c8509c4843a4. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Creating volume glance metadata for volume c1a3be05-96e5-42db-983b-c8509c4843a4 backed by image 2972c011-c2ff-40ad-8107-682efa81840b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eb9e61-2ee8-4a49-9b3c-77f8ece101c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1a3be05-96e5-42db-983b-c8509c4843a4', 'volume_size': 1, 'image_id': '2972c011-c2ff-40ad-8107-682efa81840b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2972c011-c2ff-40ad-8107-682efa81840b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4cb76ab7d72a4de5986dc6fb3d136e0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2972c011-c2ff-40ad-8107-682efa81840b', 'created_at': datetime.datetime(2026, 11, 1, 7, 45, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 7, 45, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2972c011-c2ff-40ad-8107-682efa81840b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1182334-9495-47be-8356-e83492edd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:47 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Volume volume-c1a3be05-96e5-42db-983b-c8509c4843a4 (c1a3be05-96e5-42db-983b-c8509c4843a4): created successfully Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1182334-9495-47be-8356-e83492edd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (0e1ab4d5-0a86-4c8b-8180-369d6326b885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d732636a-a537-4ff0-9c3a-282a2b385262 tempest-VolumesGetTest-200660877 None] Created volume successfully. Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (59df5ba2-e856-430d-8b51-82feed20d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99155c9b-1a8a-486b-a09a-cf202c8893df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99155c9b-1a8a-486b-a09a-cf202c8893df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860084735',display_name='tempest-VolumesGetTest-Volume-388972634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02967536-f12a-42ba-8d7b-f4be6d609a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:50Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae02676-274f-4e12-bf29-a74d4550adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae02676-274f-4e12-bf29-a74d4550adba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f2dfea-2f2b-45d7-8df3-3367c0ade235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f2dfea-2f2b-45d7-8df3-3367c0ade235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02967536-f12a-42ba-8d7b-f4be6d609a32', 'volume_name': 'volume-02967536-f12a-42ba-8d7b-f4be6d609a32', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051d4779-4d1a-4154-9e0d-fce448069f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051d4779-4d1a-4154-9e0d-fce448069f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff45a1-bbbe-4f5a-9d8b-aeb477011965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Volume 02967536-f12a-42ba-8d7b-f4be6d609a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02967536-f12a-42ba-8d7b-f4be6d609a32', 'volume_size': 1} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:08:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860084735',display_name='tempest-VolumesGetTest-Volume-388972634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02967536-f12a-42ba-8d7b-f4be6d609a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829eda2723a44a8c8c75d5840d2818d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:08:50Z,use_quota=True,user_id='a70c248ae5e94feaa022d065b6fcf11e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Creating volume 02967536-f12a-42ba-8d7b-f4be6d609a32 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:08:49 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:08:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:49 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 1073741824 Nov 01 09:08:49 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:50 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 1073741824" returned: 0 in 0.417s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:50 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 Nov 01 09:08:50 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:50 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff45a1-bbbe-4f5a-9d8b-aeb477011965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02967536-f12a-42ba-8d7b-f4be6d609a32', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f690bf84-df96-42d1-bf75-73252788d6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:08:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Volume volume-02967536-f12a-42ba-8d7b-f4be6d609a32 (02967536-f12a-42ba-8d7b-f4be6d609a32): created successfully Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f690bf84-df96-42d1-bf75-73252788d6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Flow 'volume_create_manager' (59df5ba2-e856-430d-8b51-82feed20d10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:08:50 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5a692422-4c8f-472a-9573-4a8175694272 tempest-VolumesGetTest-200660877 None] Created volume successfully. Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-02967536-f12a-42ba-8d7b-f4be6d609a32-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Lock "cinder-02967536-f12a-42ba-8d7b-f4be6d609a32-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-02967536-f12a-42ba-8d7b-f4be6d609a32" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-02967536-f12a-42ba-8d7b-f4be6d609a32" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee3cfe-f1b5-4a0c-8978-85bbced0be75]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:50 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 Nov 01 09:08:50 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:51 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32" returned: 0 in 0.354s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:51 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32 Nov 01 09:08:51 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:51 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-02967536-f12a-42ba-8d7b-f4be6d609a32" returned: 0 in 0.252s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-02967536-f12a-42ba-8d7b-f4be6d609a32" released by "delete_volume" :: held 0.645s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Created reservations ['1cb4cc4a-9fe6-4581-8941-c748de978831', 'bbeb2b52-f7c0-40e9-8c0e-e4429126bfc1', '596fafe1-1ddb-4451-8c0a-8e42fbfda028', '16da1446-9e6b-4f00-be21-37266b485730'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:51 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:51 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:51 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Deleted volume successfully. Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f23675da-1047-4e06-8e62-60df9fa07a6a tempest-VolumesGetTest-200660877 None] Lock "cinder-02967536-f12a-42ba-8d7b-f4be6d609a32-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-c1a3be05-96e5-42db-983b-c8509c4843a4-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Lock "cinder-c1a3be05-96e5-42db-983b-c8509c4843a4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Acquiring lock "cinder-quobyte-c1a3be05-96e5-42db-983b-c8509c4843a4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:08:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-c1a3be05-96e5-42db-983b-c8509c4843a4" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[004b4e39-c016-49c4-a279-678e375a5f4c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:52 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 Nov 01 09:08:52 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:52 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:52 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4 Nov 01 09:08:52 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:52 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c1a3be05-96e5-42db-983b-c8509c4843a4" returned: 0 in 0.253s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Lock "cinder-quobyte-c1a3be05-96e5-42db-983b-c8509c4843a4" released by "delete_volume" :: held 0.658s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Created reservations ['b3b1c031-bb1f-4719-81d6-719988c3259b', '06c60502-d793-4bad-af3e-9f60386811d4', '00526c59-0c23-4e06-9cf5-bf33ff523821', 'b3769615-e60c-4627-9ac1-10e8b6494f68'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:08:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:08:52 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:08:52 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:08:53 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Nov 01 09:08:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.251s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:08:53 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:08:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Deleted volume successfully. Nov 01 09:08:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-0e3496ca-bac4-482a-b392-652bb4ec371a tempest-VolumesGetTest-200660877 None] Lock "cinder-c1a3be05-96e5-42db-983b-c8509c4843a4-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:09:02 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=67,cinder:UPDATE=90,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:09:03 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=67,cinder:UPDATE=88,cinder:INSERT=28,cinder:DELETE=8 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:09:15 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Flow 'volume_create_manager' (350c2608-90d2-42a2-ab1d-7cae58107323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb9211e-7c83-4efb-a287-7f3ed43f7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb9211e-7c83-4efb-a287-7f3ed43f7086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1830718511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b9305c-b260-4c39-9a40-a75a78dcf304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb08684be0e47efa6c2a4bb07129d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:09:16Z,use_quota=True,user_id='a2b6090f4ec74c43a8e1384d0bdf555e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f81caa-caaa-420d-9a95-3ae190e3a3c0),volume_type_id=96f81caa-caaa-420d-9a95-3ae190e3a3c0)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeb2b50-8e58-4588-b789-f605e2ec32da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeb2b50-8e58-4588-b789-f605e2ec32da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bab558-7d83-4f75-90b9-06eb8bc270a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bab558-7d83-4f75-90b9-06eb8bc270a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b9305c-b260-4c39-9a40-a75a78dcf304', 'volume_name': 'volume-99b9305c-b260-4c39-9a40-a75a78dcf304', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262ccd37-5f65-4139-b10a-5b8d6fa06592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262ccd37-5f65-4139-b10a-5b8d6fa06592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4620b4b-d355-4d11-a72d-db91ef545228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Volume 99b9305c-b260-4c39-9a40-a75a78dcf304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b9305c-b260-4c39-9a40-a75a78dcf304', 'volume_size': 1} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1830718511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99b9305c-b260-4c39-9a40-a75a78dcf304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb08684be0e47efa6c2a4bb07129d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:09:16Z,use_quota=True,user_id='a2b6090f4ec74c43a8e1384d0bdf555e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f81caa-caaa-420d-9a95-3ae190e3a3c0),volume_type_id=96f81caa-caaa-420d-9a95-3ae190e3a3c0)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Creating volume 99b9305c-b260-4c39-9a40-a75a78dcf304 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:09:16 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:16 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 1073741824 Nov 01 09:09:16 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Flow 'volume_create_manager' (014090ef-3f9f-4636-9d9e-c8c654dd1b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caedec10-da7d-423e-bcbd-9005b2a84cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caedec10-da7d-423e-bcbd-9005b2a84cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-691754328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d92c1ac-5c65-4d8f-b939-e45612d1be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb08684be0e47efa6c2a4bb07129d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:09:16Z,use_quota=True,user_id='a2b6090f4ec74c43a8e1384d0bdf555e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d1142b1-2c10-45f9-ae29-eab2cfd35485),volume_type_id=2d1142b1-2c10-45f9-ae29-eab2cfd35485)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af435232-cc64-4a5b-80fd-561141a28c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af435232-cc64-4a5b-80fd-561141a28c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5485e7d7-ee72-44a9-992c-44d1651ca19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5485e7d7-ee72-44a9-992c-44d1651ca19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d92c1ac-5c65-4d8f-b939-e45612d1be1d', 'volume_name': 'volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72837c73-5fb8-4c9a-a0cc-438fd868014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72837c73-5fb8-4c9a-a0cc-438fd868014e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e972ef26-939a-482f-8cb5-99ce46bfa92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:16 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Volume 9d92c1ac-5c65-4d8f-b939-e45612d1be1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d', 'volume_size': 1} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:16 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 1073741824" returned: 0 in 0.563s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:16 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 Nov 01 09:09:16 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:16 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304" returned: 0 in 0.263s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-691754328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d92c1ac-5c65-4d8f-b939-e45612d1be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb08684be0e47efa6c2a4bb07129d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:09:16Z,use_quota=True,user_id='a2b6090f4ec74c43a8e1384d0bdf555e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d1142b1-2c10-45f9-ae29-eab2cfd35485),volume_type_id=2d1142b1-2c10-45f9-ae29-eab2cfd35485)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Creating volume 9d92c1ac-5c65-4d8f-b939-e45612d1be1d {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:09:16 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:09:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4620b4b-d355-4d11-a72d-db91ef545228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b9305c-b260-4c39-9a40-a75a78dcf304', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d 1073741824 Nov 01 09:09:17 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40add44-1f7d-4501-83cf-10372f048009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:17 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Volume volume-99b9305c-b260-4c39-9a40-a75a78dcf304 (99b9305c-b260-4c39-9a40-a75a78dcf304): created successfully Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40add44-1f7d-4501-83cf-10372f048009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Flow 'volume_create_manager' (350c2608-90d2-42a2-ab1d-7cae58107323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:09:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9213c3ed-71ec-4870-9c04-21996bc83781 tempest-TestInstancesWithCinderVolumes-809346822 None] Created volume successfully. Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Flow 'volume_create_manager' (fa76e0ff-1469-4821-9929-dc0c2c92c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab2ec5e-cf78-4a2d-92a0-f34a70e13079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab2ec5e-cf78-4a2d-92a0-f34a70e13079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1542739940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454840e1-047e-4ed3-947e-16608961ab78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb08684be0e47efa6c2a4bb07129d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:09:17Z,use_quota=True,user_id='a2b6090f4ec74c43a8e1384d0bdf555e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a684e2c8-50fd-4df0-8ff4-10a2eb43a413),volume_type_id=a684e2c8-50fd-4df0-8ff4-10a2eb43a413)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f02626-db74-4292-aa33-800c2edb1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f02626-db74-4292-aa33-800c2edb1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588153e6-9494-4d0b-8199-79416719fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:09:17 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d 1073741824" returned: 0 in 0.492s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588153e6-9494-4d0b-8199-79416719fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '454840e1-047e-4ed3-947e-16608961ab78', 'volume_name': 'volume-454840e1-047e-4ed3-947e-16608961ab78', 'volume_size': 1, 'image_id': 'afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1895304160', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7eb08684be0e47efa6c2a4bb07129d41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'created_at': datetime.datetime(2026, 11, 1, 8, 9, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4/file', 'properties': {}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7902ce01-7658-4b4e-83b0-f0146c3a625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7902ce01-7658-4b4e-83b0-f0146c3a625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af3fb7d-1842-4c86-a2ed-2933ed27fb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:17 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Volume 454840e1-047e-4ed3-947e-16608961ab78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-454840e1-047e-4ed3-947e-16608961ab78', 'volume_size': 1, 'image_id': 'afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1895304160', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7eb08684be0e47efa6c2a4bb07129d41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'created_at': datetime.datetime(2026, 11, 1, 8, 9, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4/file', 'properties': {}}, 'image_service': } Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Trying to clone 454840e1-047e-4ed3-947e-16608961ab78 from image afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:17 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d Nov 01 09:09:17 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:17 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d" returned: 0 in 0.262s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e972ef26-939a-482f-8cb5-99ce46bfa92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0431bc21-0366-4169-aafe-2713d6be3c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:17 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Volume volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d (9d92c1ac-5c65-4d8f-b939-e45612d1be1d): created successfully Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0431bc21-0366-4169-aafe-2713d6be3c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Flow 'volume_create_manager' (014090ef-3f9f-4636-9d9e-c8c654dd1b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:09:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-671c8c31-c82e-4c0a-bf8e-c71d6a215aa0 tempest-TestInstancesWithCinderVolumes-809346822 None] Created volume successfully. Nov 01 09:09:20 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD, size 20.69 MB, duration 2.92 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:09:20 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Image download 20.69 MB at 7.10 MB/s Nov 01 09:09:20 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7a01b6-d23b-482c-ab85-f41e403acab9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:09:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:20 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD Nov 01 09:09:20 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:20 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:20 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Temporary image afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 is fetched for user a2b6090f4ec74c43a8e1384d0bdf555e. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:09:20 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d642bb1-da10-4cb7-a4b9-44ac2d6a1bad]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:09:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:20 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD Nov 01 09:09:20 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:21 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1542739940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=454840e1-047e-4ed3-947e-16608961ab78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb08684be0e47efa6c2a4bb07129d41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:09:17Z,use_quota=True,user_id='a2b6090f4ec74c43a8e1384d0bdf555e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a684e2c8-50fd-4df0-8ff4-10a2eb43a413),volume_type_id=a684e2c8-50fd-4df0-8ff4-10a2eb43a413)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Creating volume 454840e1-047e-4ed3-947e-16608961ab78 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:09:21 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:21 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 1073741824 Nov 01 09:09:21 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:21 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:09:21 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:21 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 1073741824" returned: 0 in 0.442s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:21 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.267s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:09:21 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 Nov 01 09:09:21 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:21 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78" returned: 0 in 0.247s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:21 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Attempting download of afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'metadata': {}}])) to volume 454840e1-047e-4ed3-947e-16608961ab78. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc963b-6e56-4e92-b908-66ead269851b]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_8t7suc33 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:22 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_8t7suc33 Nov 01 09:09:22 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:22 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_8t7suc33" returned: 0 in 0.336s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_8t7suc33 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:22 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_8t7suc33 Nov 01 09:09:22 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:22 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_8t7suc33" returned: 1 in 0.347s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_8t7suc33' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abf932b-1b2c-4bee-85e7-1ac4c7b15914]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:09:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:22 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD Nov 01 09:09:22 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:23 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:23 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 was qcow2, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:09:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:23 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 Nov 01 09:09:23 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:24 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78" returned: 0 in 1.758s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:24 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_afb1e3a0-eaae-42a7-82b8-7b46c9abefb4_1totqu1_devstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:09:24 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Converted 112.00 MB image at 63.66 MB/s Nov 01 09:09:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:09:24 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 1G Nov 01 09:09:24 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:09:25 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 1G" returned: 0 in 0.307s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Downloaded image afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 ((None, [{'url': 'file:///opt/stack/data/glance/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'metadata': {}}])) to volume 454840e1-047e-4ed3-947e-16608961ab78 successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Temporary image afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 for user a2b6090f4ec74c43a8e1384d0bdf555e is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Marking volume 454840e1-047e-4ed3-947e-16608961ab78 as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Copying metadata from image afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 to 454840e1-047e-4ed3-947e-16608961ab78. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Creating volume glance metadata for volume 454840e1-047e-4ed3-947e-16608961ab78 backed by image afb1e3a0-eaae-42a7-82b8-7b46c9abefb4 with: {'image_id': 'afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'image_name': 'tempest-scenario-img--1895304160', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af3fb7d-1842-4c86-a2ed-2933ed27fb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-454840e1-047e-4ed3-947e-16608961ab78', 'volume_size': 1, 'image_id': 'afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1895304160', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7eb08684be0e47efa6c2a4bb07129d41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afb1e3a0-eaae-42a7-82b8-7b46c9abefb4', 'created_at': datetime.datetime(2026, 11, 1, 8, 9, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 9, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afb1e3a0-eaae-42a7-82b8-7b46c9abefb4/file', 'properties': {}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878c3951-ba0b-413c-ae7b-5287ce142d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:09:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Volume volume-454840e1-047e-4ed3-947e-16608961ab78 (454840e1-047e-4ed3-947e-16608961ab78): created successfully Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878c3951-ba0b-413c-ae7b-5287ce142d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:09:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Flow 'volume_create_manager' (fa76e0ff-1469-4821-9929-dc0c2c92c874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:09:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3ed256e5-c05d-4417-9c77-82b1c78facdc tempest-TestInstancesWithCinderVolumes-809346822 None] Created volume successfully. Nov 01 09:09:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2eb543f0-403d-40b3-afb1-d1ef659ed29c req-0fcf1e4c-adad-4d14-a4a2-d83e2d801c36 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2eb543f0-403d-40b3-afb1-d1ef659ed29c req-0fcf1e4c-adad-4d14-a4a2-d83e2d801c36 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-2eb543f0-403d-40b3-afb1-d1ef659ed29c req-0fcf1e4c-adad-4d14-a4a2-d83e2d801c36 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-2eb543f0-403d-40b3-afb1-d1ef659ed29c req-0fcf1e4c-adad-4d14-a4a2-d83e2d801c36 tempest-TestInstancesWithCinderVolumes-809346822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-454840e1-047e-4ed3-947e-16608961ab78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23a640c2-5e9d-475a-be33-fe1d9a1b4aef', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:09:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-2eb543f0-403d-40b3-afb1-d1ef659ed29c req-0fcf1e4c-adad-4d14-a4a2-d83e2d801c36 tempest-TestInstancesWithCinderVolumes-809346822 None] attachment_update completed successfully. Nov 01 09:09:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=16,cinder:SELECT=15,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:09:38 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=21,cinder:INSERT=9,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:09:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:09:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:09:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e398fc03-b0f5-4721-b00f-541fd870fcad req-01610a7e-9091-4c85-8c58-dc1a8ff72c79 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:09:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e398fc03-b0f5-4721-b00f-541fd870fcad req-01610a7e-9091-4c85-8c58-dc1a8ff72c79 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:09:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-e398fc03-b0f5-4721-b00f-541fd870fcad req-01610a7e-9091-4c85-8c58-dc1a8ff72c79 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:09:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-e398fc03-b0f5-4721-b00f-541fd870fcad req-01610a7e-9091-4c85-8c58-dc1a8ff72c79 tempest-TestInstancesWithCinderVolumes-809346822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-99b9305c-b260-4c39-9a40-a75a78dcf304', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d1dd7e3-b6e8-4dbe-b973-7b95029bebb0', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:09:59 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-e398fc03-b0f5-4721-b00f-541fd870fcad req-01610a7e-9091-4c85-8c58-dc1a8ff72c79 tempest-TestInstancesWithCinderVolumes-809346822 None] attachment_update completed successfully. Nov 01 09:10:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-c51ef640-398c-4341-b501-d359ce996e98 req-d56a1111-5272-49ec-a646-d918c5c29df2 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:10:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-c51ef640-398c-4341-b501-d359ce996e98 req-d56a1111-5272-49ec-a646-d918c5c29df2 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:10:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-c51ef640-398c-4341-b501-d359ce996e98 req-d56a1111-5272-49ec-a646-d918c5c29df2 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:10:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-c51ef640-398c-4341-b501-d359ce996e98 req-d56a1111-5272-49ec-a646-d918c5c29df2 tempest-TestInstancesWithCinderVolumes-809346822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fb9ba76-3ef9-436c-a380-7550da1f7592', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:10:01 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-c51ef640-398c-4341-b501-d359ce996e98 req-d56a1111-5272-49ec-a646-d918c5c29df2 tempest-TestInstancesWithCinderVolumes-809346822 None] attachment_update completed successfully. Nov 01 09:10:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-bc6811bb-de0f-49c7-a2b7-abe4cab5e0f6 req-ffdb180a-e0f1-47a8-a14e-67f4a2ef0248 tempest-TestInstancesWithCinderVolumes-809346822 None] Terminate volume connection completed successfully. Nov 01 09:10:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-bc6811bb-de0f-49c7-a2b7-abe4cab5e0f6 req-ffdb180a-e0f1-47a8-a14e-67f4a2ef0248 tempest-TestInstancesWithCinderVolumes-809346822 None] Deleting attachment 1d1dd7e3-b6e8-4dbe-b973-7b95029bebb0. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "cinder-99b9305c-b260-4c39-9a40-a75a78dcf304-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-99b9305c-b260-4c39-9a40-a75a78dcf304-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "cinder-quobyte-99b9305c-b260-4c39-9a40-a75a78dcf304" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-quobyte-99b9305c-b260-4c39-9a40-a75a78dcf304" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb852ec-9ce8-458d-8051-59f252945298]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:07 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 Nov 01 09:10:07 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:07 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304" returned: 0 in 0.405s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:07 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304 Nov 01 09:10:07 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:07 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-99b9305c-b260-4c39-9a40-a75a78dcf304" returned: 0 in 0.290s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-quobyte-99b9305c-b260-4c39-9a40-a75a78dcf304" released by "delete_volume" :: held 0.740s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:10:07 devstack cinder-volume[86770]: WARNING cinder.quota [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-330538282-1462209784 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-330538282-1462209784, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:10:07 devstack cinder-volume[86770]: WARNING cinder.quota [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-330538282-1462209784 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-330538282-1462209784, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Created reservations ['5c7655e3-d228-4845-9be9-57a4b6c0b056', '3946539d-0b31-4783-9b96-c0775d64052c', '6122c787-0166-4b9e-adb6-9569aac022af', '44f33ad2-b193-401b-a312-a8cdbe88d52d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:10:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:08 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:10:08 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:08 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.277s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:08 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:10:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Deleted volume successfully. Nov 01 09:10:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6bbfb6d3-9e54-4012-86e9-6a95147a2553 tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-99b9305c-b260-4c39-9a40-a75a78dcf304-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:10:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-38e2f1b2-a3bc-4f34-ac94-39d443b41ec6 req-4985a413-70a9-47e1-a0ec-4c95eaa78c80 tempest-TestInstancesWithCinderVolumes-809346822 None] Terminate volume connection completed successfully. Nov 01 09:10:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-38e2f1b2-a3bc-4f34-ac94-39d443b41ec6 req-4985a413-70a9-47e1-a0ec-4c95eaa78c80 tempest-TestInstancesWithCinderVolumes-809346822 None] Deleting attachment 6fb9ba76-3ef9-436c-a380-7550da1f7592. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "cinder-9d92c1ac-5c65-4d8f-b939-e45612d1be1d-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-9d92c1ac-5c65-4d8f-b939-e45612d1be1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "cinder-quobyte-9d92c1ac-5c65-4d8f-b939-e45612d1be1d" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-quobyte-9d92c1ac-5c65-4d8f-b939-e45612d1be1d" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a8dd96-a79c-469f-8251-bcb700826811]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:11 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d Nov 01 09:10:11 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:11 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d" returned: 0 in 0.388s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:11 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d Nov 01 09:10:11 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:12 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-9d92c1ac-5c65-4d8f-b939-e45612d1be1d" returned: 0 in 0.272s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-quobyte-9d92c1ac-5c65-4d8f-b939-e45612d1be1d" released by "delete_volume" :: held 0.717s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:10:12 devstack cinder-volume[86770]: WARNING cinder.quota [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555299620-1228133643 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555299620-1228133643, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:10:12 devstack cinder-volume[86770]: WARNING cinder.quota [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555299620-1228133643 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555299620-1228133643, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Created reservations ['d144ec09-8726-45c2-a547-4d48dc2cb9f2', '65a11612-5d14-4b54-8e45-668f773585e4', '72c09b6c-8793-4231-8a85-75a5477e1ff3', 'aa920248-38d9-4a0a-9f6b-ad2201417a19'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:12 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:10:12 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:12 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:10:12 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Deleted volume successfully. Nov 01 09:10:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-261e0284-2c0f-4f51-9315-eb524c5dd9ac tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-9d92c1ac-5c65-4d8f-b939-e45612d1be1d-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:10:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-42465ce2-97b6-4bcc-a3b0-5981d2271564 req-e00cc93c-a719-4e08-9788-6e99a47a64e1 tempest-TestInstancesWithCinderVolumes-809346822 None] Terminate volume connection completed successfully. Nov 01 09:10:15 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-42465ce2-97b6-4bcc-a3b0-5981d2271564 req-e00cc93c-a719-4e08-9788-6e99a47a64e1 tempest-TestInstancesWithCinderVolumes-809346822 None] Deleting attachment 23a640c2-5e9d-475a-be33-fe1d9a1b4aef. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:10:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "cinder-454840e1-047e-4ed3-947e-16608961ab78-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:10:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-454840e1-047e-4ed3-947e-16608961ab78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:10:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "cinder-quobyte-454840e1-047e-4ed3-947e-16608961ab78" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:10:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-quobyte-454840e1-047e-4ed3-947e-16608961ab78" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:10:16 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0512ac25-870c-4dcb-8f5d-25fd9c480608]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:10:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:16 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 Nov 01 09:10:16 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:16 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78" returned: 0 in 0.377s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:17 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78 Nov 01 09:10:17 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:17 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-454840e1-047e-4ed3-947e-16608961ab78" returned: 0 in 0.254s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-quobyte-454840e1-047e-4ed3-947e-16608961ab78" released by "delete_volume" :: held 0.675s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:10:17 devstack cinder-volume[86770]: WARNING cinder.quota [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800543928-1094795272 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800543928-1094795272, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:10:17 devstack cinder-volume[86770]: WARNING cinder.quota [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800543928-1094795272 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800543928-1094795272, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Created reservations ['fedb61aa-04e5-4b82-9edb-b5825e8c1eb1', 'a72e33f7-8db7-41b0-ac77-6607bb61edac', '3fdd9d51-5fd0-4555-9c80-6e138348f42a', '070b4689-bb5c-4324-81aa-98e7e66a8dd1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:17 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:10:17 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:17 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.258s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:10:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Deleted volume successfully. Nov 01 09:10:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-37a62913-fdcd-4583-b5e7-0efc9d897aec tempest-TestInstancesWithCinderVolumes-809346822 None] Lock "cinder-454840e1-047e-4ed3-947e-16608961ab78-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:21 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:10:21 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:21 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.245s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:10:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:10:27 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=29,cinder:UPDATE=31,cinder:INSERT=5 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:10:27 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=33,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Flow 'volume_create_manager' (40d8b1db-7834-4204-9010-77d83e4d148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54168ba6-84cd-437f-9452-bc1944fc3e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54168ba6-84cd-437f-9452-bc1944fc3e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-84410682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cda13e9-6c2d-40e5-9eb2-37f2077ed28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6c8b941f704781b2279cd1e04dcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:10:48Z,use_quota=True,user_id='5cc35b725df9466aaf10403930bc313c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fa3fb1-d332-4742-85a6-c0bcd91b9683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fa3fb1-d332-4742-85a6-c0bcd91b9683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3336a5c-00dc-4cd2-abfa-837882bd64a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3336a5c-00dc-4cd2-abfa-837882bd64a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cda13e9-6c2d-40e5-9eb2-37f2077ed28d', 'volume_name': 'volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4a3bfa-73c4-4983-997a-7ea2ffc6ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4a3bfa-73c4-4983-997a-7ea2ffc6ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8067e24-31eb-4253-b285-f19db11eb3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:10:48 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Volume 0cda13e9-6c2d-40e5-9eb2-37f2077ed28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d', 'volume_size': 1} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-84410682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cda13e9-6c2d-40e5-9eb2-37f2077ed28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6c8b941f704781b2279cd1e04dcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:10:48Z,use_quota=True,user_id='5cc35b725df9466aaf10403930bc313c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Creating volume 0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:10:48 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:10:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:48 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d 1073741824 Nov 01 09:10:48 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:49 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d 1073741824" returned: 0 in 0.445s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:10:49 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d Nov 01 09:10:49 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:10:49 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" returned: 0 in 0.266s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8067e24-31eb-4253-b285-f19db11eb3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c22e04-d993-46f0-8300-6f09b4b65bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:10:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Volume volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d (0cda13e9-6c2d-40e5-9eb2-37f2077ed28d): created successfully Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c22e04-d993-46f0-8300-6f09b4b65bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:10:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Flow 'volume_create_manager' (40d8b1db-7834-4204-9010-77d83e4d148b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:10:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a93a93fa-3ccd-4032-acfd-077a4499d901 tempest-TestStampPattern-1387442755 None] Created volume successfully. Nov 01 09:10:59 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:10:59 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:11:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7fd47402-d6f9-411b-a0ad-fcdc7c12b5cc req-b30daa6b-2038-4e4a-ae9f-1a7c8826e9ec tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:11:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7fd47402-d6f9-411b-a0ad-fcdc7c12b5cc req-b30daa6b-2038-4e4a-ae9f-1a7c8826e9ec tempest-TestStampPattern-1387442755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:11:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-7fd47402-d6f9-411b-a0ad-fcdc7c12b5cc req-b30daa6b-2038-4e4a-ae9f-1a7c8826e9ec tempest-TestStampPattern-1387442755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:11:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-7fd47402-d6f9-411b-a0ad-fcdc7c12b5cc req-b30daa6b-2038-4e4a-ae9f-1a7c8826e9ec tempest-TestStampPattern-1387442755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb11ae55-07f0-456e-929d-49a10cee093b', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:11:18 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-7fd47402-d6f9-411b-a0ad-fcdc7c12b5cc req-b30daa6b-2038-4e4a-ae9f-1a7c8826e9ec tempest-TestStampPattern-1387442755 None] attachment_update completed successfully. Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:21 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:11:21 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:21 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.267s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:11:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:11:22 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-007eb3bf-1459-4a18-9597-fda31bac2f03 req-8e2bb89e-692a-4c51-8834-e7e4726a9f93 tempest-TestStampPattern-1387442755 None] Terminate volume connection completed successfully. Nov 01 09:11:22 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-007eb3bf-1459-4a18-9597-fda31bac2f03 req-8e2bb89e-692a-4c51-8834-e7e4726a9f93 tempest-TestStampPattern-1387442755 None] Deleting attachment eb11ae55-07f0-456e-929d-49a10cee093b. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:11:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:11:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:11:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Creating offline snapshot 78f8a83e-40c9-4571-94ea-1fa7f3847c91 of volume 0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:11:23 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aa065c-2719-487a-a471-b9fc83c02d01]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:11:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:23 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d Nov 01 09:11:23 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:23 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" returned: 0 in 0.382s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:23 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 1G Nov 01 09:11:23 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:24 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 1G" returned: 0 in 0.402s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:24 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 Nov 01 09:11:24 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:24 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91" returned: 0 in 0.276s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:24 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 is being set with open permissions: ugo+rw Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:24 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 Nov 01 09:11:24 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:24 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:24 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.info Nov 01 09:11:24 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:24 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.info" returned: 0 in 0.259s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:24 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.info is being set with open permissions: ugo+rw Nov 01 09:11:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:24 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.info Nov 01 09:11:24 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:25 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.info" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:11:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1a4af99e-2ab4-4169-b30c-f5464dc30413 tempest-TestStampPattern-1387442755 None] Create snapshot completed successfully Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Flow 'volume_create_manager' (50ae0ba1-fc5c-4d74-a7dc-f42662f46fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0746284a-d237-4e48-9baa-9f42b7da8c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0746284a-d237-4e48-9baa-9f42b7da8c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1521549588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678fbe0c-dd4d-403b-b0ef-b67c361900ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6c8b941f704781b2279cd1e04dcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78f8a83e-40c9-4571-94ea-1fa7f3847c91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:11:32Z,use_quota=True,user_id='5cc35b725df9466aaf10403930bc313c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d340cf0-5f9f-48d4-827e-7488bed15a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d340cf0-5f9f-48d4-827e-7488bed15a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ff749-782a-4580-a455-7fb24b6da949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ff749-782a-4580-a455-7fb24b6da949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '678fbe0c-dd4d-403b-b0ef-b67c361900ba', 'volume_name': 'volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba', 'volume_size': 1, 'snapshot_id': '78f8a83e-40c9-4571-94ea-1fa7f3847c91'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d96ba3a-f7aa-430e-b75d-4b06fa7c4977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d96ba3a-f7aa-430e-b75d-4b06fa7c4977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acfc9ff-6e8b-4471-93d1-542d46bbf308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:11:32 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Volume 678fbe0c-dd4d-403b-b0ef-b67c361900ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba', 'volume_size': 1, 'snapshot_id': '78f8a83e-40c9-4571-94ea-1fa7f3847c91'} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-quobyte-78f8a83e-40c9-4571-94ea-1fa7f3847c91-678fbe0c-dd4d-403b-b0ef-b67c361900ba" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-78f8a83e-40c9-4571-94ea-1fa7f3847c91-678fbe0c-dd4d-403b-b0ef-b67c361900ba" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Creating volume 678fbe0c-dd4d-403b-b0ef-b67c361900ba from snapshot 78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-quobyte-678fbe0c-dd4d-403b-b0ef-b67c361900ba" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-678fbe0c-dd4d-403b-b0ef-b67c361900ba" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] snapshot: 78f8a83e-40c9-4571-94ea-1fa7f3847c91, volume: 678fbe0c-dd4d-403b-b0ef-b67c361900ba, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[27375268-e0b7-468c-bb99-6b8aca63a4c0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:32 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 Nov 01 09:11:32 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:32 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91" returned: 0 in 0.395s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4f5ade-3a21-4633-bdf8-c6d9441d9ac7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:11:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:32 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d Nov 01 09:11:32 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:33 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" returned: 0 in 0.435s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:11:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:11:33 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:11:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:33 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba Nov 01 09:11:33 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:41 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba" returned: 0 in 8.388s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:41 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d, size 1024.00 MB, duration 8.39 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:11:41 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Converted 1024.00 MB image at 122.06 MB/s Nov 01 09:11:41 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba is being set with open permissions: ugo+rw Nov 01 09:11:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:11:41 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba Nov 01 09:11:41 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:11:41 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Nov 01 09:11:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba" returned: 0 in 0.340s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:11:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-678fbe0c-dd4d-403b-b0ef-b67c361900ba" released by "_copy_volume_from_snapshot" :: held 9.661s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:11:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-78f8a83e-40c9-4571-94ea-1fa7f3847c91-678fbe0c-dd4d-403b-b0ef-b67c361900ba" released by "_create_volume_from_snapshot" :: held 9.753s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:11:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.770s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:11:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acfc9ff-6e8b-4471-93d1-542d46bbf308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba', 'volume_size': 1, 'snapshot_id': '78f8a83e-40c9-4571-94ea-1fa7f3847c91'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:11:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37679b4c-39b9-4fd0-9678-178477125b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:11:42 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Volume volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba (678fbe0c-dd4d-403b-b0ef-b67c361900ba): created successfully Nov 01 09:11:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37679b4c-39b9-4fd0-9678-178477125b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:11:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Flow 'volume_create_manager' (50ae0ba1-fc5c-4d74-a7dc-f42662f46fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:11:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5a8d3639-4add-40fb-abc8-67f084929aad tempest-TestStampPattern-1387442755 None] Created volume successfully. Nov 01 09:11:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:11:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:12:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-0c9ffdb1-72dd-4c13-8b37-ec2ac04c28e5 req-78b8e8aa-e22c-48c3-85af-43d5aa5953f4 tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-0c9ffdb1-72dd-4c13-8b37-ec2ac04c28e5 req-78b8e8aa-e22c-48c3-85af-43d5aa5953f4 tempest-TestStampPattern-1387442755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [req-0c9ffdb1-72dd-4c13-8b37-ec2ac04c28e5 req-78b8e8aa-e22c-48c3-85af-43d5aa5953f4 tempest-TestStampPattern-1387442755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-0c9ffdb1-72dd-4c13-8b37-ec2ac04c28e5 req-78b8e8aa-e22c-48c3-85af-43d5aa5953f4 tempest-TestStampPattern-1387442755 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e', 'name': 'volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f6fd2dd-e6e8-43cb-a581-5f63ced65475', 'enforce_multipath': True} {{(pid=86770) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:12:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-0c9ffdb1-72dd-4c13-8b37-ec2ac04c28e5 req-78b8e8aa-e22c-48c3-85af-43d5aa5953f4 tempest-TestStampPattern-1387442755 None] attachment_update completed successfully. Nov 01 09:12:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [req-e4539673-e070-4704-9b3c-a551791ca118 req-3031bddd-9b7b-4a3f-85ee-81c2610c13dc tempest-TestStampPattern-1387442755 None] Terminate volume connection completed successfully. Nov 01 09:12:11 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [req-e4539673-e070-4704-9b3c-a551791ca118 req-3031bddd-9b7b-4a3f-85ee-81c2610c13dc tempest-TestStampPattern-1387442755 None] Deleting attachment 6f6fd2dd-e6e8-43cb-a581-5f63ced65475. {{(pid=86770) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:12:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-678fbe0c-dd4d-403b-b0ef-b67c361900ba-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Lock "cinder-678fbe0c-dd4d-403b-b0ef-b67c361900ba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-quobyte-678fbe0c-dd4d-403b-b0ef-b67c361900ba" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-678fbe0c-dd4d-403b-b0ef-b67c361900ba" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b05460-6325-4820-b9ee-e2df3261a7a0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:15 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba Nov 01 09:12:15 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:16 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:16 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba Nov 01 09:12:16 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:16 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-678fbe0c-dd4d-403b-b0ef-b67c361900ba" returned: 0 in 0.264s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-678fbe0c-dd4d-403b-b0ef-b67c361900ba" released by "delete_volume" :: held 0.683s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Created reservations ['b6b30445-25a8-439f-a562-0fbe75d08ab6', '53aa6124-8c20-4ff5-be6b-577f3a5b566d', '7b7bfb4a-9995-4019-9811-3cab49de092d', '75e314b5-7e18-4c31-906f-7e236136658f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:16 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:12:16 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:16 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.268s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:12:16 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Deleted volume successfully. Nov 01 09:12:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-58e60135-ae3d-4a60-8358-7c8153b303b0 tempest-TestStampPattern-1387442755 None] Lock "cinder-678fbe0c-dd4d-403b-b0ef-b67c361900ba-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-78f8a83e-40c9-4571-94ea-1fa7f3847c91-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Lock "cinder-78f8a83e-40c9-4571-94ea-1fa7f3847c91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-quobyte-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-quobyte-78f8a83e-40c9-4571-94ea-1fa7f3847c91" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-78f8a83e-40c9-4571-94ea-1fa7f3847c91" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Deleting offline snapshot 78f8a83e-40c9-4571-94ea-1fa7f3847c91 of volume 0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] snapshot_file for this snap is: volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5808a56b-72eb-4208-a5a3-8701f43e0208]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:17 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 Nov 01 09:12:17 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:17 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91" returned: 0 in 0.366s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99ac9a9-c91c-4b40-89d3-052da8efe9dc]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:17 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d Nov 01 09:12:17 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:18 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" returned: 0 in 0.540s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:18 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 Nov 01 09:12:18 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:18 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91" returned: 0 in 0.319s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:18 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91 Nov 01 09:12:18 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:18 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d.78f8a83e-40c9-4571-94ea-1fa7f3847c91" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-78f8a83e-40c9-4571-94ea-1fa7f3847c91" released by "_delete_snapshot" :: held 1.575s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" released by "delete_snapshot" :: held 1.600s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Created reservations ['50b0ce3a-c670-4763-aa6f-1810b1be3c93', '66b61ee0-85d7-4ab3-8d57-6b01aa3df5a2', 'f3b79086-d828-466f-800b-06c7aad14e60', '4d35013a-5e09-4a1f-be28-f4be30bfb6e0'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:12:18 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Delete snapshot completed successfully. Nov 01 09:12:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-57b5e811-5a4b-4692-9c4d-74884cfbeb94 tempest-TestStampPattern-1387442755 None] Lock "cinder-78f8a83e-40c9-4571-94ea-1fa7f3847c91-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:21 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:12:21 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:21 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.305s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:12:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:12:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Lock "cinder-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Acquiring lock "cinder-quobyte-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6487a5aa-15c2-4d08-9c3d-7e0c36508c86]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:22 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d Nov 01 09:12:22 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:23 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" returned: 0 in 0.357s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:23 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d Nov 01 09:12:23 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:23 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Lock "cinder-quobyte-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d" released by "delete_volume" :: held 0.654s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Created reservations ['1b7696cd-4a0a-43dd-9f50-ef7b1c22b8a9', 'c2afd46c-7186-46db-a8ba-4d790649be1d', 'e052bb7b-5d5a-418f-a6a2-71857915e2e5', '06668936-8ad6-4bd5-9099-3bdfc9fb6a91'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:23 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:12:23 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:23 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:12:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Deleted volume successfully. Nov 01 09:12:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5a309c00-e8c0-4748-83cf-d888c2d4d243 tempest-TestStampPattern-1387442755 None] Lock "cinder-0cda13e9-6c2d-40e5-9eb2-37f2077ed28d-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:33 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:12:33 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Flow 'volume_create_manager' (c68a1908-31e1-4abb-a1e6-0c03b8220a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ae8cf9-3a02-4a19-834d-9d8365531968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ae8cf9-3a02-4a19-834d-9d8365531968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e24f86-71ea-44d5-8b42-2668975d2f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672409698fe494590c2a96b780358f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:12:38Z,use_quota=True,user_id='9acb3eeb4b6f4c9c90893f868adb781d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2eec3f1-30cf-463c-9c24-857849be66dd),volume_type_id=b2eec3f1-30cf-463c-9c24-857849be66dd)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c899c058-8d44-4506-9cec-4a756857e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c899c058-8d44-4506-9cec-4a756857e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b3f51-8cb3-4693-a830-aad831a7c572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b3f51-8cb3-4693-a830-aad831a7c572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5e24f86-71ea-44d5-8b42-2668975d2f65', 'volume_name': 'volume-a5e24f86-71ea-44d5-8b42-2668975d2f65', 'volume_size': 1, 'image_id': 'ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e96401792b1d37f221e9b5f30f6a825', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a672409698fe494590c2a96b780358f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6eadb3ddac7607def7c568a55bc707b41ffce6de46203d294de644209420a40adc120d9b7bf5b6a486c96a754194fba5b6af9ba188f3c6309e89d059b20ba09a', 'id': 'ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'created_at': datetime.datetime(2026, 11, 1, 8, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58700bdc-0059-4738-965b-facb90518acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58700bdc-0059-4738-965b-facb90518acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148ec5c5-0a32-4398-a310-e4f1bb782857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:38 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Volume a5e24f86-71ea-44d5-8b42-2668975d2f65: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5e24f86-71ea-44d5-8b42-2668975d2f65', 'volume_size': 1, 'image_id': 'ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e96401792b1d37f221e9b5f30f6a825', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a672409698fe494590c2a96b780358f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6eadb3ddac7607def7c568a55bc707b41ffce6de46203d294de644209420a40adc120d9b7bf5b6a486c96a754194fba5b6af9ba188f3c6309e89d059b20ba09a', 'id': 'ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'created_at': datetime.datetime(2026, 11, 1, 8, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Trying to clone a5e24f86-71ea-44d5-8b42-2668975d2f65 from image ddf748eb-7bb5-4538-832e-4a191e2fa15c at location (None, [{'url': 'file:///opt/stack/data/glance/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:12:38 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee32969-7c41-47ff-99e2-36c4385ba74d]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:39 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD Nov 01 09:12:39 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:39 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:39 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD Nov 01 09:12:39 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:39 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD" returned: 1 in 0.309s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Temporary image ddf748eb-7bb5-4538-832e-4a191e2fa15c is fetched for user 9acb3eeb4b6f4c9c90893f868adb781d. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd6a448-942e-4e31-a2bd-5a35b15dd073]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:39 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD Nov 01 09:12:39 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:39 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:40 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD Nov 01 09:12:40 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:40 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e24f86-71ea-44d5-8b42-2668975d2f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a672409698fe494590c2a96b780358f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:12:38Z,use_quota=True,user_id='9acb3eeb4b6f4c9c90893f868adb781d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2eec3f1-30cf-463c-9c24-857849be66dd),volume_type_id=b2eec3f1-30cf-463c-9c24-857849be66dd)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Creating volume a5e24f86-71ea-44d5-8b42-2668975d2f65 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:12:40 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:40 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 1073741824 Nov 01 09:12:40 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:40 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 1073741824" returned: 0 in 0.431s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:40 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 Nov 01 09:12:40 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:40 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65" returned: 0 in 0.237s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:40 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Attempting download of ddf748eb-7bb5-4538-832e-4a191e2fa15c ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'metadata': {}}])) to volume a5e24f86-71ea-44d5-8b42-2668975d2f65. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[897d7286-81c6-4c6b-a1b7-ae8c3ccef93a]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf748eb-7bb5-4538-832e-4a191e2fa15c_8kqggxe1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:41 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf748eb-7bb5-4538-832e-4a191e2fa15c_8kqggxe1 Nov 01 09:12:41 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:41 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf748eb-7bb5-4538-832e-4a191e2fa15c_8kqggxe1" returned: 0 in 0.315s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf748eb-7bb5-4538-832e-4a191e2fa15c_8kqggxe1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:41 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf748eb-7bb5-4538-832e-4a191e2fa15c_8kqggxe1 Nov 01 09:12:41 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:41 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf748eb-7bb5-4538-832e-4a191e2fa15c_8kqggxe1" returned: 1 in 0.316s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf748eb-7bb5-4538-832e-4a191e2fa15c_8kqggxe1' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c24f599-09b7-456e-aa2d-5eb42f48e3e9]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:41 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD Nov 01 09:12:41 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:41 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:42 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD Nov 01 09:12:42 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:42 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:12:42 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] ddf748eb-7bb5-4538-832e-4a191e2fa15c was raw, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:12:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:42 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 Nov 01 09:12:42 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:42 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65" returned: 0 in 0.462s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:42 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ddf748eb-7bb5-4538-832e-4a191e2fa15c_720t9hjwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:12:42 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:12:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:42 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 1G Nov 01 09:12:42 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:43 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 1G" returned: 0 in 0.316s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Downloaded image ddf748eb-7bb5-4538-832e-4a191e2fa15c ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'metadata': {}}])) to volume a5e24f86-71ea-44d5-8b42-2668975d2f65 successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Temporary image ddf748eb-7bb5-4538-832e-4a191e2fa15c for user 9acb3eeb4b6f4c9c90893f868adb781d is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Marking volume a5e24f86-71ea-44d5-8b42-2668975d2f65 as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Copying metadata from image ddf748eb-7bb5-4538-832e-4a191e2fa15c to a5e24f86-71ea-44d5-8b42-2668975d2f65. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Creating volume glance metadata for volume a5e24f86-71ea-44d5-8b42-2668975d2f65 backed by image ddf748eb-7bb5-4538-832e-4a191e2fa15c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0e96401792b1d37f221e9b5f30f6a825', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148ec5c5-0a32-4398-a310-e4f1bb782857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e24f86-71ea-44d5-8b42-2668975d2f65', 'volume_size': 1, 'image_id': 'ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0e96401792b1d37f221e9b5f30f6a825', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a672409698fe494590c2a96b780358f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6eadb3ddac7607def7c568a55bc707b41ffce6de46203d294de644209420a40adc120d9b7bf5b6a486c96a754194fba5b6af9ba188f3c6309e89d059b20ba09a', 'id': 'ddf748eb-7bb5-4538-832e-4a191e2fa15c', 'created_at': datetime.datetime(2026, 11, 1, 8, 12, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 12, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf748eb-7bb5-4538-832e-4a191e2fa15c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79cd92a8-ef25-4d23-981e-9f1b9b6a599d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:43 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Volume volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 (a5e24f86-71ea-44d5-8b42-2668975d2f65): created successfully Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79cd92a8-ef25-4d23-981e-9f1b9b6a599d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Flow 'volume_create_manager' (c68a1908-31e1-4abb-a1e6-0c03b8220a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:12:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0306da9f-d4d3-4fbe-858a-fcfda88c63cf tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Created volume successfully. Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Acquiring lock "cinder-a5e24f86-71ea-44d5-8b42-2668975d2f65-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "cinder-a5e24f86-71ea-44d5-8b42-2668975d2f65-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Acquiring lock "cinder-quobyte-a5e24f86-71ea-44d5-8b42-2668975d2f65" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "cinder-quobyte-a5e24f86-71ea-44d5-8b42-2668975d2f65" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[98256808-562c-4e69-a921-ab2f42c5ed6d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:43 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 Nov 01 09:12:43 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:44 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65" returned: 0 in 0.377s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:44 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65 Nov 01 09:12:44 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:44 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a5e24f86-71ea-44d5-8b42-2668975d2f65" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "cinder-quobyte-a5e24f86-71ea-44d5-8b42-2668975d2f65" released by "delete_volume" :: held 0.670s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:44 devstack cinder-volume[86770]: WARNING cinder.quota [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:12:44 devstack cinder-volume[86770]: WARNING cinder.quota [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Created reservations ['a35ec623-9637-4790-a99a-13d89830452e', '72a6c1ed-2beb-4056-857e-d8a516b34368', '4ca3d93b-2cab-4ee7-969e-55da3d75669a', '02cc0133-13e3-439b-8ad8-ad63db54413e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:44 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:12:44 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:44 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.252s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:12:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Deleted volume successfully. Nov 01 09:12:44 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-93f17943-48ac-4155-899a-0ebb936aa351 tempest-VolumeAndVolumeTypeFromImageTest-309204328 None] Lock "cinder-a5e24f86-71ea-44d5-8b42-2668975d2f65-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:48 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:12:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Flow 'volume_create_manager' (2a1fd008-8375-46de-9338-b8be668d3468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:12:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36fc92b-0304-40c1-9db3-1ea2485e261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36fc92b-0304-40c1-9db3-1ea2485e261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a9cbe-a512-4b55-901b-183d94080f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08ce4b71ddd474c965f7745d6256b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:12:49Z,use_quota=True,user_id='7d0b127641304177beac638a6fb52fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5554ac-dcba-411c-8fa2-bb9d3c474db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5554ac-dcba-411c-8fa2-bb9d3c474db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c46bfa3-9354-46a8-a63c-97ec6a2384e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c46bfa3-9354-46a8-a63c-97ec6a2384e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47a9cbe-a512-4b55-901b-183d94080f61', 'volume_name': 'volume-d47a9cbe-a512-4b55-901b-183d94080f61', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ebdd9a-d3a3-4bc2-9407-0ed3d64c1841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ebdd9a-d3a3-4bc2-9407-0ed3d64c1841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3c02b8-f386-4d20-b81c-df7bab1530ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Volume d47a9cbe-a512-4b55-901b-183d94080f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47a9cbe-a512-4b55-901b-183d94080f61', 'volume_size': 1} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a9cbe-a512-4b55-901b-183d94080f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08ce4b71ddd474c965f7745d6256b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:12:49Z,use_quota=True,user_id='7d0b127641304177beac638a6fb52fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Creating volume d47a9cbe-a512-4b55-901b-183d94080f61 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:12:49 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:49 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 1073741824 Nov 01 09:12:49 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:49 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 1073741824" returned: 0 in 0.421s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:49 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 Nov 01 09:12:49 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:49 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61" returned: 0 in 0.251s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3c02b8-f386-4d20-b81c-df7bab1530ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47a9cbe-a512-4b55-901b-183d94080f61', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dfd10e-5dcf-4964-9851-13b329386a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Volume volume-d47a9cbe-a512-4b55-901b-183d94080f61 (d47a9cbe-a512-4b55-901b-183d94080f61): created successfully Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dfd10e-5dcf-4964-9851-13b329386a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Flow 'volume_create_manager' (2a1fd008-8375-46de-9338-b8be668d3468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:12:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4e738f57-8084-41dd-842a-71df45236774 tempest-CinderUnicodeTest-205212706 None] Created volume successfully. Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Flow 'volume_create_manager' (cc409696-5fb7-4650-b249-7b926a16c51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c923c7a-2c2d-4219-bf77-d021568b40f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c923c7a-2c2d-4219-bf77-d021568b40f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:12:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-830354925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca974cd-4c68-4640-9039-97c57b4dac7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08ce4b71ddd474c965f7745d6256b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:12:50Z,use_quota=True,user_id='7d0b127641304177beac638a6fb52fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee48bd9-1c3d-4e01-adb5-3c7919f340c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee48bd9-1c3d-4e01-adb5-3c7919f340c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e407061b-99bc-47fb-9ecc-6eed7c707206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e407061b-99bc-47fb-9ecc-6eed7c707206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca974cd-4c68-4640-9039-97c57b4dac7c', 'volume_name': 'volume-1ca974cd-4c68-4640-9039-97c57b4dac7c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de0e0b2-ff9a-4890-9259-066c175d48d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de0e0b2-ff9a-4890-9259-066c175d48d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02197248-6a18-4240-ac8e-47fc3f56e037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Volume 1ca974cd-4c68-4640-9039-97c57b4dac7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca974cd-4c68-4640-9039-97c57b4dac7c', 'volume_size': 1} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:12:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-830354925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca974cd-4c68-4640-9039-97c57b4dac7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b08ce4b71ddd474c965f7745d6256b50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:12:50Z,use_quota=True,user_id='7d0b127641304177beac638a6fb52fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Creating volume 1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:12:50 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:50 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c 1073741824 Nov 01 09:12:50 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:50 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c 1073741824" returned: 0 in 0.409s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:50 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c Nov 01 09:12:50 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:51 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c" returned: 0 in 0.241s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02197248-6a18-4240-ac8e-47fc3f56e037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca974cd-4c68-4640-9039-97c57b4dac7c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6323a9d6-08f2-4af4-b7cc-f5f25617580e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:12:51 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Volume volume-1ca974cd-4c68-4640-9039-97c57b4dac7c (1ca974cd-4c68-4640-9039-97c57b4dac7c): created successfully Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6323a9d6-08f2-4af4-b7cc-f5f25617580e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Flow 'volume_create_manager' (cc409696-5fb7-4650-b249-7b926a16c51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:12:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e620b485-591a-465d-8791-2abf9ed1ae8c tempest-CinderUnicodeTest-205212706 None] Created volume successfully. Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Creating offline snapshot 31c53903-ce0d-4b35-ad0b-b54322f20ec8 of volume 1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c4c2e-be23-4b7e-9307-79c1ce52fc93]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:51 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c Nov 01 09:12:51 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:52 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c" returned: 0 in 0.354s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:52 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 1G Nov 01 09:12:52 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:52 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 1G" returned: 0 in 0.381s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca974cd-4c68-4640-9039-97c57b4dac7c -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:52 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca974cd-4c68-4640-9039-97c57b4dac7c -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 Nov 01 09:12:52 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:52 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca974cd-4c68-4640-9039-97c57b4dac7c -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8" returned: 0 in 0.301s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:52 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 is being set with open permissions: ugo+rw Nov 01 09:12:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:52 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 Nov 01 09:12:52 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:52 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8" returned: 0 in 0.246s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:53 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.info Nov 01 09:12:53 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:53 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.info" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:53 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.info is being set with open permissions: ugo+rw Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:53 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.info Nov 01 09:12:53 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:53 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.info" returned: 0 in 0.247s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5ca28077-1e4a-4735-ac92-a388bcde5ae5 tempest-CinderUnicodeTest-205212706 None] Create snapshot completed successfully Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Acquiring lock "cinder-31c53903-ce0d-4b35-ad0b-b54322f20ec8-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Lock "cinder-31c53903-ce0d-4b35-ad0b-b54322f20ec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Acquiring lock "cinder-quobyte-1ca974cd-4c68-4640-9039-97c57b4dac7c" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-1ca974cd-4c68-4640-9039-97c57b4dac7c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Acquiring lock "cinder-quobyte-31c53903-ce0d-4b35-ad0b-b54322f20ec8" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-31c53903-ce0d-4b35-ad0b-b54322f20ec8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Deleting offline snapshot 31c53903-ce0d-4b35-ad0b-b54322f20ec8 of volume 1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] snapshot_file for this snap is: volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dfca3d-1bba-4e58-a38d-61f73bf7bdbe]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:53 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 Nov 01 09:12:53 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:54 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8" returned: 0 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca974cd-4c68-4640-9039-97c57b4dac7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f582f2-3c87-4938-bedc-b5ee0e3574e2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:54 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c Nov 01 09:12:54 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:54 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c" returned: 0 in 0.379s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:54 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 Nov 01 09:12:54 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:54 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8" returned: 0 in 0.336s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:54 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8 Nov 01 09:12:54 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:55 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c.31c53903-ce0d-4b35-ad0b-b54322f20ec8" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-31c53903-ce0d-4b35-ad0b-b54322f20ec8" released by "_delete_snapshot" :: held 1.425s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-1ca974cd-4c68-4640-9039-97c57b4dac7c" released by "delete_snapshot" :: held 1.447s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Created reservations ['d154c314-2685-41a5-a778-f6396577f7be', '310ee914-9d3e-4786-b6e0-248e4e971e09', 'd73dce02-5732-4128-88cf-ccc5c6525a0d', '5f846cc7-8a8d-4665-91f1-9199e9b3508e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:12:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Delete snapshot completed successfully. Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9207cc30-d1b3-4e85-9649-280fb9216aac tempest-CinderUnicodeTest-205212706 None] Lock "cinder-31c53903-ce0d-4b35-ad0b-b54322f20ec8-delete_snapshot" released by "delete_snapshot" :: held 1.576s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "cinder-1ca974cd-4c68-4640-9039-97c57b4dac7c-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-1ca974cd-4c68-4640-9039-97c57b4dac7c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "cinder-quobyte-1ca974cd-4c68-4640-9039-97c57b4dac7c" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-1ca974cd-4c68-4640-9039-97c57b4dac7c" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6712db3-ec71-4ac2-99d1-2db8dbb1de43]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:56 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c Nov 01 09:12:56 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:56 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c" returned: 0 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:56 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c Nov 01 09:12:56 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:56 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1ca974cd-4c68-4640-9039-97c57b4dac7c" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-1ca974cd-4c68-4640-9039-97c57b4dac7c" released by "delete_volume" :: held 0.665s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Created reservations ['00d5b8e3-01c9-4900-a578-99774a63900a', 'ee48cb36-5350-4320-b4d7-04ccaccd9ba8', '24c64c43-4fdb-435d-a2c6-4fa24261c651', '21d75acd-0eb5-4eb3-87c5-0f1bf1aa26f1'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:56 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:12:56 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:57 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:12:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Deleted volume successfully. Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-fc7acb3a-965f-43f5-ae26-9c5c00ae35f6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-1ca974cd-4c68-4640-9039-97c57b4dac7c-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "cinder-d47a9cbe-a512-4b55-901b-183d94080f61-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-d47a9cbe-a512-4b55-901b-183d94080f61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "cinder-quobyte-d47a9cbe-a512-4b55-901b-183d94080f61" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-d47a9cbe-a512-4b55-901b-183d94080f61" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dcedc9-200b-4f04-9f1d-f501f216a7cd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:57 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 Nov 01 09:12:57 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:57 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61" returned: 0 in 0.361s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:57 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61 Nov 01 09:12:57 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:57 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d47a9cbe-a512-4b55-901b-183d94080f61" returned: 0 in 0.247s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-quobyte-d47a9cbe-a512-4b55-901b-183d94080f61" released by "delete_volume" :: held 0.653s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Created reservations ['36374d7a-bab4-45e3-8288-93bbd4bf8316', '75b8b126-a917-473b-a9cc-a5ea547219bf', 'a83db711-4a6d-47db-a12d-f1ac93c3e64d', '96504d0d-3ec3-4a4b-b825-a3fce23cff05'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:12:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:12:57 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:12:57 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:12:58 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 01 09:12:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.248s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:12:58 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:12:58 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Deleted volume successfully. Nov 01 09:12:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-6ab4bd22-4c33-4275-a049-31bdc110b8c6 tempest-CinderUnicodeTest-205212706 None] Lock "cinder-d47a9cbe-a512-4b55-901b-183d94080f61-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (c83c611f-852c-4ee8-9699-14f5cee2fdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33798c86-295d-4ad1-9a16-93c5ebb840e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33798c86-295d-4ad1-9a16-93c5ebb840e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374386616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126b8a1b-8b06-42e8-b4e2-12b052f9cc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:01Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6bc051-9e18-4731-9f21-7815f5fdb64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6bc051-9e18-4731-9f21-7815f5fdb64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdb029b-6d87-492f-8c9a-c2d892474f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdb029b-6d87-492f-8c9a-c2d892474f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '126b8a1b-8b06-42e8-b4e2-12b052f9cc31', 'volume_name': 'volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0a232e-6186-455d-9684-f6e199aa049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0a232e-6186-455d-9684-f6e199aa049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ab0eb6-7ab7-410a-adad-fe269fdd65e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:01 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Volume 126b8a1b-8b06-42e8-b4e2-12b052f9cc31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31', 'volume_size': 1} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374386616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126b8a1b-8b06-42e8-b4e2-12b052f9cc31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:01Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Creating volume 126b8a1b-8b06-42e8-b4e2-12b052f9cc31 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:01 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:01 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 1073741824 Nov 01 09:13:01 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:02 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 1073741824" returned: 0 in 0.411s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:02 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 Nov 01 09:13:02 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:02 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31" returned: 0 in 0.267s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ab0eb6-7ab7-410a-adad-fe269fdd65e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f08c377-ef86-4425-a6f3-8367d5e584d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:02 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Volume volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 (126b8a1b-8b06-42e8-b4e2-12b052f9cc31): created successfully Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f08c377-ef86-4425-a6f3-8367d5e584d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (c83c611f-852c-4ee8-9699-14f5cee2fdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-66882d6b-83d0-4978-a55e-7858fdf8dfd9 tempest-ProjectReaderTests-214889704 None] Created volume successfully. Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-126b8a1b-8b06-42e8-b4e2-12b052f9cc31-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Lock "cinder-126b8a1b-8b06-42e8-b4e2-12b052f9cc31-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-quobyte-126b8a1b-8b06-42e8-b4e2-12b052f9cc31" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-126b8a1b-8b06-42e8-b4e2-12b052f9cc31" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a81e3-5095-43df-81d6-1c23cbac2355]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:02 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 Nov 01 09:13:02 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:03 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31" returned: 0 in 0.367s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:03 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31 Nov 01 09:13:03 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:03 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-126b8a1b-8b06-42e8-b4e2-12b052f9cc31" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-126b8a1b-8b06-42e8-b4e2-12b052f9cc31" released by "delete_volume" :: held 0.661s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Created reservations ['c7e72cc8-8019-47a2-9c79-506e00f4d9be', '4c351fb0-6ebe-4ead-be0d-1ca43f7f3114', '5ac44fa5-26e4-4b28-b410-626854b33169', '51f1615f-6c3b-4d5c-9254-ecacac15f3af'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:03 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:03 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:03 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Deleted volume successfully. Nov 01 09:13:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f92cf7bb-6acf-4d1a-b7ca-6631886bb2a2 tempest-ProjectReaderTests-214889704 None] Lock "cinder-126b8a1b-8b06-42e8-b4e2-12b052f9cc31-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (1585ee11-ad62-48a2-b9af-a714407b97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0d04f-2600-4c94-b43b-f8665c457814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0d04f-2600-4c94-b43b-f8665c457814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432000692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755a4659-56d4-4f37-a44e-510007c0cb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:04Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff915a7-c9a6-4b6a-93aa-ba11fc4de157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff915a7-c9a6-4b6a-93aa-ba11fc4de157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b54a37a-381d-4595-ac16-c1193b5291a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b54a37a-381d-4595-ac16-c1193b5291a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755a4659-56d4-4f37-a44e-510007c0cb67', 'volume_name': 'volume-755a4659-56d4-4f37-a44e-510007c0cb67', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e6dcd0-2676-4b78-b2bb-700d6975c406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e6dcd0-2676-4b78-b2bb-700d6975c406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6601748d-7901-4612-86f0-c2e2e7ab3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:04 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Volume 755a4659-56d4-4f37-a44e-510007c0cb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755a4659-56d4-4f37-a44e-510007c0cb67', 'volume_size': 1} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432000692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755a4659-56d4-4f37-a44e-510007c0cb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:04Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Creating volume 755a4659-56d4-4f37-a44e-510007c0cb67 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:04 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:04 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 1073741824 Nov 01 09:13:04 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:04 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 1073741824" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:04 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 Nov 01 09:13:04 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:05 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6601748d-7901-4612-86f0-c2e2e7ab3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755a4659-56d4-4f37-a44e-510007c0cb67', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e31b28-414f-4deb-b20b-e934ade3fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Volume volume-755a4659-56d4-4f37-a44e-510007c0cb67 (755a4659-56d4-4f37-a44e-510007c0cb67): created successfully Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e31b28-414f-4deb-b20b-e934ade3fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (1585ee11-ad62-48a2-b9af-a714407b97a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5a55b83c-d7ae-4ace-9938-6be16403b449 tempest-ProjectReaderTests-214889704 None] Created volume successfully. Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-755a4659-56d4-4f37-a44e-510007c0cb67-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Lock "cinder-755a4659-56d4-4f37-a44e-510007c0cb67-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-quobyte-755a4659-56d4-4f37-a44e-510007c0cb67" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-755a4659-56d4-4f37-a44e-510007c0cb67" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bde061-346d-4d58-a269-01dbff9f3c38]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:05 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 Nov 01 09:13:05 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:05 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67" returned: 0 in 0.370s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:05 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67 Nov 01 09:13:05 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:06 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-755a4659-56d4-4f37-a44e-510007c0cb67" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-755a4659-56d4-4f37-a44e-510007c0cb67" released by "delete_volume" :: held 0.668s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Created reservations ['5a409f28-e892-4112-b36a-945640e5bde4', 'a16329a4-2a51-4ec9-a33b-ded049612f93', '3c0e867b-4b28-4d18-b0ca-03827607f9f7', 'b8fce5f4-5b5c-4f8a-8d81-53970633ef2b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:06 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:06 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:06 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Deleted volume successfully. Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4dd54541-9ec5-4d11-b1bd-edccabfa1888 tempest-ProjectReaderTests-214889704 None] Lock "cinder-755a4659-56d4-4f37-a44e-510007c0cb67-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (8477f8b2-7bdb-40e6-9282-c080cade3ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd9ff2c-d114-488d-baa8-af1b62af3412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd9ff2c-d114-488d-baa8-af1b62af3412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088946446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a95e55-658d-4ab4-9103-2ce86c3dd844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:07Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2a80da-5c3e-4745-a2fc-1966b74a9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2a80da-5c3e-4745-a2fc-1966b74a9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73894e99-e829-4778-8414-1a3cb5fcbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73894e99-e829-4778-8414-1a3cb5fcbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a95e55-658d-4ab4-9103-2ce86c3dd844', 'volume_name': 'volume-09a95e55-658d-4ab4-9103-2ce86c3dd844', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f41673-a0ef-47e8-8454-0cd8f11452f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f41673-a0ef-47e8-8454-0cd8f11452f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63383e32-d7a5-4a55-b766-ddf356eaf717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:07 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Volume 09a95e55-658d-4ab4-9103-2ce86c3dd844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a95e55-658d-4ab4-9103-2ce86c3dd844', 'volume_size': 1} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088946446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a95e55-658d-4ab4-9103-2ce86c3dd844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:07Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Creating volume 09a95e55-658d-4ab4-9103-2ce86c3dd844 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:07 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:07 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 1073741824 Nov 01 09:13:07 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:07 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 1073741824" returned: 0 in 0.413s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:07 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 Nov 01 09:13:07 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:07 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63383e32-d7a5-4a55-b766-ddf356eaf717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a95e55-658d-4ab4-9103-2ce86c3dd844', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb5fdbb-2b87-4eff-a52c-aacbf8341cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:07 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Volume volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 (09a95e55-658d-4ab4-9103-2ce86c3dd844): created successfully Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb5fdbb-2b87-4eff-a52c-aacbf8341cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:07 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (8477f8b2-7bdb-40e6-9282-c080cade3ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-55385515-12a7-4234-b1f6-0e4805787d6e tempest-ProjectReaderTests-214889704 None] Created volume successfully. Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-09a95e55-658d-4ab4-9103-2ce86c3dd844-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Lock "cinder-09a95e55-658d-4ab4-9103-2ce86c3dd844-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-quobyte-09a95e55-658d-4ab4-9103-2ce86c3dd844" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-09a95e55-658d-4ab4-9103-2ce86c3dd844" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[24868362-d336-42d0-a959-2acd6716c9e6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:08 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 Nov 01 09:13:08 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:08 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844" returned: 0 in 0.368s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:08 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844 Nov 01 09:13:08 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:08 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-09a95e55-658d-4ab4-9103-2ce86c3dd844" returned: 0 in 0.248s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-09a95e55-658d-4ab4-9103-2ce86c3dd844" released by "delete_volume" :: held 0.656s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Created reservations ['c42a32cb-d0e1-4f61-a055-3e2af83731a5', '03aa63be-518d-4fb7-8a70-e9260fd60a7f', '1bc90ad7-c1e4-409a-b8a3-e8d9e136e3a4', '0d4494b1-2d58-488a-9701-74a5d195e3be'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:08 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:08 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:09 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.245s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Deleted volume successfully. Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c38055f3-5531-4b04-af66-0c70f730d721 tempest-ProjectReaderTests-214889704 None] Lock "cinder-09a95e55-658d-4ab4-9103-2ce86c3dd844-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (4d78f170-ac17-4a74-86a2-37c9d53ba29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410f6eaa-658a-430b-9c92-5fd085de92c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410f6eaa-658a-430b-9c92-5fd085de92c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-343020453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5727746-1c3a-41fc-a818-a949341eaabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:10Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3e8366-6cf6-4fec-a4d0-95f293647951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3e8366-6cf6-4fec-a4d0-95f293647951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5630bf-807d-4e4f-81d9-1079fb57d993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5630bf-807d-4e4f-81d9-1079fb57d993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5727746-1c3a-41fc-a818-a949341eaabc', 'volume_name': 'volume-b5727746-1c3a-41fc-a818-a949341eaabc', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49145e47-9798-4f1b-8d45-9d70f5e42a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49145e47-9798-4f1b-8d45-9d70f5e42a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990bf04b-6c27-4180-afc2-8b4049ee1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:09 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Volume b5727746-1c3a-41fc-a818-a949341eaabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5727746-1c3a-41fc-a818-a949341eaabc', 'volume_size': 1} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-343020453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5727746-1c3a-41fc-a818-a949341eaabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b559bf9d2a4b4faef89ecf408eed72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:10Z,use_quota=True,user_id='aab5b93551ab49c389159f630f712579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Creating volume b5727746-1c3a-41fc-a818-a949341eaabc {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:09 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:09 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc 1073741824 Nov 01 09:13:09 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:10 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc 1073741824" returned: 0 in 0.404s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:10 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc Nov 01 09:13:10 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:10 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc" returned: 0 in 0.246s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990bf04b-6c27-4180-afc2-8b4049ee1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5727746-1c3a-41fc-a818-a949341eaabc', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6faacdc-75a9-43cf-913d-c1639f9ce60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:10 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Volume volume-b5727746-1c3a-41fc-a818-a949341eaabc (b5727746-1c3a-41fc-a818-a949341eaabc): created successfully Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6faacdc-75a9-43cf-913d-c1639f9ce60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Flow 'volume_create_manager' (4d78f170-ac17-4a74-86a2-37c9d53ba29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4b94a31a-8305-4bc8-851f-b0fe48b2c399 tempest-ProjectReaderTests-214889704 None] Created volume successfully. Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-b5727746-1c3a-41fc-a818-a949341eaabc-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Lock "cinder-b5727746-1c3a-41fc-a818-a949341eaabc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Acquiring lock "cinder-quobyte-b5727746-1c3a-41fc-a818-a949341eaabc" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-b5727746-1c3a-41fc-a818-a949341eaabc" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6d6030-7799-43ec-9328-b79249479def]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:10 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc Nov 01 09:13:10 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:11 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc" returned: 0 in 0.349s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:11 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc Nov 01 09:13:11 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:11 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b5727746-1c3a-41fc-a818-a949341eaabc" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Lock "cinder-quobyte-b5727746-1c3a-41fc-a818-a949341eaabc" released by "delete_volume" :: held 0.628s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Created reservations ['7956f1ab-e4b5-4cd2-831c-3b0a6a06dd70', '45d8204e-b847-4f60-9ea0-187df45919e0', '5a20c070-ee41-499a-85fa-b39c5b8bf07d', 'ba7c1cbc-20ec-4eef-bbf4-f292f3732232'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:11 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:11 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:11 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Deleted volume successfully. Nov 01 09:13:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-23a7dfa4-6271-4b62-8750-f3db9b1c82e4 tempest-ProjectReaderTests-214889704 None] Lock "cinder-b5727746-1c3a-41fc-a818-a949341eaabc-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=69,cinder:INSERT=23,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:13:21 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:21 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=59,cinder:UPDATE=84,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:13:21 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.428s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:13:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (52a0c0ba-961a-4f7b-9a16-94b5f60b8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90152e96-7d07-4d4f-8bdd-8a29b1bc38f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90152e96-7d07-4d4f-8bdd-8a29b1bc38f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453309177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cb311a-b103-4227-85b5-5d9da83b703e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:24Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865938ae-9756-4a29-968e-f1c86b3b4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (865938ae-9756-4a29-968e-f1c86b3b4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d619ea7a-bfe0-465e-8661-72d9f93b2ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d619ea7a-bfe0-465e-8661-72d9f93b2ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cb311a-b103-4227-85b5-5d9da83b703e', 'volume_name': 'volume-a3cb311a-b103-4227-85b5-5d9da83b703e', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d505e24-f6dc-4c15-9381-a856f12952bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d505e24-f6dc-4c15-9381-a856f12952bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91073bfb-0bc0-46e4-b9b2-5a28b0084ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:24 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Volume a3cb311a-b103-4227-85b5-5d9da83b703e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cb311a-b103-4227-85b5-5d9da83b703e', 'volume_size': 1} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453309177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cb311a-b103-4227-85b5-5d9da83b703e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:24Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Creating volume a3cb311a-b103-4227-85b5-5d9da83b703e {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:24 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:24 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e 1073741824 Nov 01 09:13:24 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:25 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e 1073741824" returned: 0 in 0.745s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:25 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e Nov 01 09:13:25 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (e7bd7584-00f2-4075-8f41-db686bc7909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82541c0e-de1b-4a4f-a159-4e8c796f8ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Flow 'volume_create_manager' (d30733b5-4cba-44d3-bfc1-a66fd5f22df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10604cb-3daa-4f2c-b420-7bbecfd56ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82541c0e-de1b-4a4f-a159-4e8c796f8ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1198771014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe3db20-a6b3-49e7-b3a3-720e7af66985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:25Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c00cf2-7a40-46b4-a406-1a31d7b96cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c00cf2-7a40-46b4-a406-1a31d7b96cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162bffd7-920a-4784-9637-75e6e2978e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162bffd7-920a-4784-9637-75e6e2978e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe3db20-a6b3-49e7-b3a3-720e7af66985', 'volume_name': 'volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7783150-3c0d-450b-a365-1153a7713f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7783150-3c0d-450b-a365-1153a7713f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205e2913-7f2e-4760-9134-0e6309f00022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Volume cbe3db20-a6b3-49e7-b3a3-720e7af66985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985', 'volume_size': 1} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10604cb-3daa-4f2c-b420-7bbecfd56ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6d5112-d386-45e2-8268-11c6e9e7f69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d4867ba03d4907a646b7b7938d6bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:25Z,use_quota=True,user_id='a427c271df1e4b8fb01309952fa16f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc43eed-0929-4f3d-a791-fcb8b53c00a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc43eed-0929-4f3d-a791-fcb8b53c00a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2329b045-490d-438b-bd76-aeb2a64a3bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2329b045-490d-438b-bd76-aeb2a64a3bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6d5112-d386-45e2-8268-11c6e9e7f69c', 'volume_name': 'volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85394734-df1c-4462-9b16-cad6695664ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85394734-df1c-4462-9b16-cad6695664ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d3f33b-4db9-42ca-a50b-a1238244168f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Volume 5a6d5112-d386-45e2-8268-11c6e9e7f69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c', 'volume_size': 1} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e" returned: 0 in 0.584s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1198771014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe3db20-a6b3-49e7-b3a3-720e7af66985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:25Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Creating volume cbe3db20-a6b3-49e7-b3a3-720e7af66985 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:25 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91073bfb-0bc0-46e4-b9b2-5a28b0084ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cb311a-b103-4227-85b5-5d9da83b703e', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee066fa-fd3c-4d17-9f51-e4272cb73302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:25 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 1073741824 Nov 01 09:13:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Volume volume-a3cb311a-b103-4227-85b5-5d9da83b703e (a3cb311a-b103-4227-85b5-5d9da83b703e): created successfully Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee066fa-fd3c-4d17-9f51-e4272cb73302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:25 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (52a0c0ba-961a-4f7b-9a16-94b5f60b8e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:26 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4c68e26e-40f1-4871-941d-43deaecb612c tempest-CreateVolumesFromImageTest-2020743230 None] Created volume successfully. Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (ea3320c1-0a8f-4fa6-9e76-8feeaf546a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3c26d-526d-4b55-ac2b-88244c9a1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3c26d-526d-4b55-ac2b-88244c9a1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114985912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49c36ce-160b-4235-9c4c-71bd202863e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:26Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5243730f-64d9-4a53-8d19-96a6b0827f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5243730f-64d9-4a53-8d19-96a6b0827f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63ac6cf-2270-4768-9493-76c8cd841783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63ac6cf-2270-4768-9493-76c8cd841783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a49c36ce-160b-4235-9c4c-71bd202863e1', 'volume_name': 'volume-a49c36ce-160b-4235-9c4c-71bd202863e1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f502944f-fe4b-408d-b878-85139b63ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f502944f-fe4b-408d-b878-85139b63ba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d42c04-6f78-4ea2-ba9c-f50d32f51abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Volume a49c36ce-160b-4235-9c4c-71bd202863e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a49c36ce-160b-4235-9c4c-71bd202863e1', 'volume_size': 1} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:26 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 1073741824" returned: 0 in 0.650s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:26 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 Nov 01 09:13:26 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (03fb01fb-8d08-435f-a517-bb21525c74f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe255ae-de3c-49b7-81e0-cca6af65c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe255ae-de3c-49b7-81e0-cca6af65c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1198303791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b2950b-1a62-401b-b1f4-d9e214f97232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:27Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ec2113-d8de-422f-9a4e-72c4efcf1e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ec2113-d8de-422f-9a4e-72c4efcf1e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b99660-d981-492a-af55-0dae71256494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b99660-d981-492a-af55-0dae71256494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b2950b-1a62-401b-b1f4-d9e214f97232', 'volume_name': 'volume-47b2950b-1a62-401b-b1f4-d9e214f97232', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bfcd50-a8b2-42ea-ad59-3c4338b17866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bfcd50-a8b2-42ea-ad59-3c4338b17866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c6de55-c604-49ac-8d34-e9509bea724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Volume 47b2950b-1a62-401b-b1f4-d9e214f97232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b2950b-1a62-401b-b1f4-d9e214f97232', 'volume_size': 1} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:26 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985" returned: 0 in 0.421s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6d5112-d386-45e2-8268-11c6e9e7f69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d4867ba03d4907a646b7b7938d6bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:25Z,use_quota=True,user_id='a427c271df1e4b8fb01309952fa16f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Creating volume 5a6d5112-d386-45e2-8268-11c6e9e7f69c {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:27 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205e2913-7f2e-4760-9134-0e6309f00022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166136e-0f58-4f27-8b04-1aab32e5606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Volume volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 (cbe3db20-a6b3-49e7-b3a3-720e7af66985): created successfully Nov 01 09:13:27 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c 1073741824 Nov 01 09:13:27 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166136e-0f58-4f27-8b04-1aab32e5606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (e7bd7584-00f2-4075-8f41-db686bc7909a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6a96594f-154a-4a50-88af-6881eace1fb6 tempest-CreateVolumesFromImageTest-2020743230 None] Created volume successfully. Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (4cbb0aad-76c6-4323-9a77-907e26f4ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e0895f-1c23-4f0e-9940-d548c53a61ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e0895f-1c23-4f0e-9940-d548c53a61ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1572546842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b196af9e-45ca-45a4-a6ea-58602782d6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:27Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539731b3-06eb-4626-b331-a50ba604b746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539731b3-06eb-4626-b331-a50ba604b746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b423a-227b-4e84-9db8-060445b6f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715b423a-227b-4e84-9db8-060445b6f034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b196af9e-45ca-45a4-a6ea-58602782d6e8', 'volume_name': 'volume-b196af9e-45ca-45a4-a6ea-58602782d6e8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f47bf8-d633-467f-beb8-85bc1ee85cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f47bf8-d633-467f-beb8-85bc1ee85cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0394b22-d394-4524-abc2-91f8bfd1e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Volume b196af9e-45ca-45a4-a6ea-58602782d6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b196af9e-45ca-45a4-a6ea-58602782d6e8', 'volume_size': 1} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:27 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c 1073741824" returned: 0 in 0.602s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:27 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c Nov 01 09:13:27 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Flow 'volume_create_manager' (1af9eb96-ddcb-4b53-8100-efe9c943a4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a9d7dd-ba10-454a-992f-46e3d104c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a9d7dd-ba10-454a-992f-46e3d104c23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35440fa-684a-4860-803d-150979685afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb2be7d9fcc468791243c81081aab54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:28Z,use_quota=True,user_id='14a3c97dedd2441588ba1ce5045f4d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04926fc8-9da2-4c1c-8d7a-ce211393d118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04926fc8-9da2-4c1c-8d7a-ce211393d118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865ded56-331f-4015-80b0-eafc0006e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c" returned: 0 in 0.320s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114985912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49c36ce-160b-4235-9c4c-71bd202863e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:26Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Creating volume a49c36ce-160b-4235-9c4c-71bd202863e1 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:27 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d3f33b-4db9-42ca-a50b-a1238244168f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3f5b0a-8198-4bf7-b83e-80af301cd5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:28 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 1073741824 Nov 01 09:13:28 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Volume volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c (5a6d5112-d386-45e2-8268-11c6e9e7f69c): created successfully Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3f5b0a-8198-4bf7-b83e-80af301cd5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Flow 'volume_create_manager' (d30733b5-4cba-44d3-bfc1-a66fd5f22df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d4b8e7c4-9f23-4e42-8495-9252dd3e4366 tempest-CinderUnicodeTest-757181986 None] Created volume successfully. Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865ded56-331f-4015-80b0-eafc0006e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e35440fa-684a-4860-803d-150979685afe', 'volume_name': 'volume-e35440fa-684a-4860-803d-150979685afe', 'volume_size': 1, 'image_id': '7c620555-ca45-46a5-9c32-47a853035d71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c620555-ca45-46a5-9c32-47a853035d71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b98a87534b59ab64acd3b1d70dccb7e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfb2be7d9fcc468791243c81081aab54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dadd645e87dcc6b67e86c559fb889635c2310638b57aba85a1978fae874274292f62111dbb3d908c3a7aa7b126f0fe7082961a57cdd3fa276012e5b21f38902b', 'id': '7c620555-ca45-46a5-9c32-47a853035d71', 'created_at': datetime.datetime(2026, 11, 1, 8, 13, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 13, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c620555-ca45-46a5-9c32-47a853035d71/file', 'properties': {}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b660b1-4f0a-4d36-b637-d23537d08e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b660b1-4f0a-4d36-b637-d23537d08e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8270833-8cd4-4ec6-a715-5f95de1384db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:28 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Volume e35440fa-684a-4860-803d-150979685afe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e35440fa-684a-4860-803d-150979685afe', 'volume_size': 1, 'image_id': '7c620555-ca45-46a5-9c32-47a853035d71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c620555-ca45-46a5-9c32-47a853035d71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b98a87534b59ab64acd3b1d70dccb7e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfb2be7d9fcc468791243c81081aab54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dadd645e87dcc6b67e86c559fb889635c2310638b57aba85a1978fae874274292f62111dbb3d908c3a7aa7b126f0fe7082961a57cdd3fa276012e5b21f38902b', 'id': '7c620555-ca45-46a5-9c32-47a853035d71', 'created_at': datetime.datetime(2026, 11, 1, 8, 13, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 13, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c620555-ca45-46a5-9c32-47a853035d71/file', 'properties': {}}, 'image_service': } Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Trying to clone e35440fa-684a-4860-803d-150979685afe from image 7c620555-ca45-46a5-9c32-47a853035d71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c620555-ca45-46a5-9c32-47a853035d71', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:13:28 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a6fe1-fbbc-493c-b7cc-cbfffba97fce]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:28 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 1073741824" returned: 0 in 0.568s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:28 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 Nov 01 09:13:28 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:28 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD Nov 01 09:13:28 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:28 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.195s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1198303791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b2950b-1a62-401b-b1f4-d9e214f97232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:27Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Creating volume 47b2950b-1a62-401b-b1f4-d9e214f97232 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:29 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:29 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:29 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 1073741824 Nov 01 09:13:29 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d42c04-6f78-4ea2-ba9c-f50d32f51abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a49c36ce-160b-4235-9c4c-71bd202863e1', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678c5a8e-07f8-43d5-b17a-f4282f51479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Volume volume-a49c36ce-160b-4235-9c4c-71bd202863e1 (a49c36ce-160b-4235-9c4c-71bd202863e1): created successfully Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678c5a8e-07f8-43d5-b17a-f4282f51479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (ea3320c1-0a8f-4fa6-9e76-8feeaf546a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Flow 'volume_create_manager' (14945042-63d8-4a51-9cd3-27a406807786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8db75d-b4e9-407b-aa45-6bb741690961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD Nov 01 09:13:29 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:29 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e99803d8-87ef-4ce5-87c3-9e4c5bc6569f tempest-CreateVolumesFromImageTest-2020743230 None] Created volume successfully. Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8db75d-b4e9-407b-aa45-6bb741690961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1737532777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08da9e03-b9c7-4a0c-a806-406c30637623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d4867ba03d4907a646b7b7938d6bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:29Z,use_quota=True,user_id='a427c271df1e4b8fb01309952fa16f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5aa92e-54a5-4e24-a4a3-ef2a63c110f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5aa92e-54a5-4e24-a4a3-ef2a63c110f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e264dc-d421-4333-9c52-ef5a3d876ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e264dc-d421-4333-9c52-ef5a3d876ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08da9e03-b9c7-4a0c-a806-406c30637623', 'volume_name': 'volume-08da9e03-b9c7-4a0c-a806-406c30637623', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2022a26e-7949-4bb4-9ed3-ca77d40db307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2022a26e-7949-4bb4-9ed3-ca77d40db307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cf84b9-5541-4399-85c5-6cc1b407f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Volume 08da9e03-b9c7-4a0c-a806-406c30637623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08da9e03-b9c7-4a0c-a806-406c30637623', 'volume_size': 1} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:29 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD" returned: 1 in 0.424s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Temporary image 7c620555-ca45-46a5-9c32-47a853035d71 is fetched for user 14a3c97dedd2441588ba1ce5045f4d1a. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66ab624-9035-4940-913f-de7f1063f494]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:29 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 1073741824" returned: 0 in 0.608s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:29 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD Nov 01 09:13:29 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:29 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 Nov 01 09:13:29 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Flow 'volume_create_manager' (401c67e9-0656-4174-a867-8dacc94000a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a8d4ba-a015-4346-8ce1-fe66063657f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a8d4ba-a015-4346-8ce1-fe66063657f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c80bb70-6186-4e36-8e71-3f913c565683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a239807518f4859bdc38c6039c293af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:30Z,use_quota=True,user_id='6612eb43ab80407784bebecbaae381fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(232298a0-252a-43d8-a87a-2e58f945ae64),volume_type_id=232298a0-252a-43d8-a87a-2e58f945ae64)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccaf5cd2-e6f0-440a-8eb3-0e71019e3aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccaf5cd2-e6f0-440a-8eb3-0e71019e3aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:29 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0db62da-8979-428b-a321-076a6819737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.image.glance [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Creating Keystone auth plugin from conf {{(pid=86770) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:13:29 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232" returned: 0 in 0.334s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.625s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1572546842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b196af9e-45ca-45a4-a6ea-58602782d6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb0de126dfce4089a2898aff6818cd23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:27Z,use_quota=True,user_id='4841d8c0e4464e41ba7521159a04a0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Creating volume b196af9e-45ca-45a4-a6ea-58602782d6e8 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c6de55-c604-49ac-8d34-e9509bea724f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b2950b-1a62-401b-b1f4-d9e214f97232', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:30 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 1073741824 Nov 01 09:13:30 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b518e5-bbb8-4217-98dd-be273ad4cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Volume volume-47b2950b-1a62-401b-b1f4-d9e214f97232 (47b2950b-1a62-401b-b1f4-d9e214f97232): created successfully Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b518e5-bbb8-4217-98dd-be273ad4cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (03fb01fb-8d08-435f-a517-bb21525c74f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b37d1c35-ab52-4962-a2b3-949425ff8cd4 tempest-CreateVolumesFromImageTest-2020743230 None] Created volume successfully. Nov 01 09:13:30 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD Nov 01 09:13:30 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0db62da-8979-428b-a321-076a6819737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c80bb70-6186-4e36-8e71-3f913c565683', 'volume_name': 'volume-2c80bb70-6186-4e36-8e71-3f913c565683', 'volume_size': 1, 'image_id': '4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5797ac936dd82230a6239c422044e92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a239807518f4859bdc38c6039c293af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0ecc468e51e97f287c3098ff4e0d3c64da9dc7d5a60e70386cdbf8f5685ffd5ab619a5db281044092dfd95ae80a90face629dc18a2fe027c0d35c13ec1f1c86', 'id': '4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'created_at': datetime.datetime(2026, 11, 1, 8, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7944143f-e714-4529-b8ba-8877c9991bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7944143f-e714-4529-b8ba-8877c9991bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc40536-a498-4cac-867f-604700aec9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Volume 2c80bb70-6186-4e36-8e71-3f913c565683: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c80bb70-6186-4e36-8e71-3f913c565683', 'volume_size': 1, 'image_id': '4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5797ac936dd82230a6239c422044e92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a239807518f4859bdc38c6039c293af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0ecc468e51e97f287c3098ff4e0d3c64da9dc7d5a60e70386cdbf8f5685ffd5ab619a5db281044092dfd95ae80a90face629dc18a2fe027c0d35c13ec1f1c86', 'id': '4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'created_at': datetime.datetime(2026, 11, 1, 8, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Trying to clone 2c80bb70-6186-4e36-8e71-3f913c565683 from image 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'metadata': {}}]). {{(pid=86770) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:13:30 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb622a9-7f9c-4e28-b341-60c9b78068f3]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:30 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 1073741824" returned: 0 in 0.513s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:30 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD Nov 01 09:13:30 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:30 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 Nov 01 09:13:30 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:30 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:30 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1737532777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08da9e03-b9c7-4a0c-a806-406c30637623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d4867ba03d4907a646b7b7938d6bee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:29Z,use_quota=True,user_id='a427c271df1e4b8fb01309952fa16f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Creating volume 08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0394b22-d394-4524-abc2-91f8bfd1e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b196af9e-45ca-45a4-a6ea-58602782d6e8', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:30 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 1073741824 Nov 01 09:13:30 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2ffe67-b5ed-4a90-a64f-01d7a2412460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Volume volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 (b196af9e-45ca-45a4-a6ea-58602782d6e8): created successfully Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2ffe67-b5ed-4a90-a64f-01d7a2412460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Flow 'volume_create_manager' (4cbb0aad-76c6-4323-9a77-907e26f4ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d8b25852-5df7-4400-94ca-bdf19e032f2e tempest-CreateVolumesFromImageTest-2020743230 None] Created volume successfully. Nov 01 09:13:30 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD Nov 01 09:13:30 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:31 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD" returned: 1 in 0.384s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Temporary image 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 is fetched for user 6612eb43ab80407784bebecbaae381fb. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[08470c5e-791d-4c6a-ad03-ed2af5ba77f1]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:31 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 1073741824" returned: 0 in 0.484s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:31 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 Nov 01 09:13:31 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:31 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD Nov 01 09:13:31 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:31 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-b196af9e-45ca-45a4-a6ea-58602782d6e8-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35440fa-684a-4860-803d-150979685afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb2be7d9fcc468791243c81081aab54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:28Z,use_quota=True,user_id='14a3c97dedd2441588ba1ce5045f4d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Creating volume e35440fa-684a-4860-803d-150979685afe {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:31 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:31 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:31 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe 1073741824 Nov 01 09:13:31 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-b196af9e-45ca-45a4-a6ea-58602782d6e8-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cf84b9-5541-4399-85c5-6cc1b407f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08da9e03-b9c7-4a0c-a806-406c30637623', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acb89b8-b347-4e60-9b7a-eb2d03fc0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Volume volume-08da9e03-b9c7-4a0c-a806-406c30637623 (08da9e03-b9c7-4a0c-a806-406c30637623): created successfully Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acb89b8-b347-4e60-9b7a-eb2d03fc0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Flow 'volume_create_manager' (14945042-63d8-4a51-9cd3-27a406807786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-81f7cf3d-7602-4600-97ba-1fff23112447 tempest-CinderUnicodeTest-757181986 None] Created volume successfully. Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-quobyte-b196af9e-45ca-45a4-a6ea-58602782d6e8" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-b196af9e-45ca-45a4-a6ea-58602782d6e8" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:31 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD Nov 01 09:13:31 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c6ae5b-7047-4262-8fb6-9501b4c73ccb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:32 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 Nov 01 09:13:32 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:32 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:32 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe 1073741824" returned: 0 in 0.532s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:32 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe Nov 01 09:13:32 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:32 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8" returned: 0 in 0.465s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:32 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8 Nov 01 09:13:32 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:32 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe" returned: 0 in 0.311s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c80bb70-6186-4e36-8e71-3f913c565683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a239807518f4859bdc38c6039c293af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:30Z,use_quota=True,user_id='6612eb43ab80407784bebecbaae381fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(232298a0-252a-43d8-a87a-2e58f945ae64),volume_type_id=232298a0-252a-43d8-a87a-2e58f945ae64)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Creating volume 2c80bb70-6186-4e36-8e71-3f913c565683 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:32 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:32 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 1073741824 Nov 01 09:13:32 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Attempting download of 7c620555-ca45-46a5-9c32-47a853035d71 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c620555-ca45-46a5-9c32-47a853035d71', 'metadata': {}}])) to volume e35440fa-684a-4860-803d-150979685afe. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:13:32 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b196af9e-45ca-45a4-a6ea-58602782d6e8" returned: 0 in 0.316s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-b196af9e-45ca-45a4-a6ea-58602782d6e8" released by "delete_volume" :: held 0.841s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500444d-d8fd-4c71-b283-4d8367f0cafd]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c620555-ca45-46a5-9c32-47a853035d71_mvpdcn0m {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Created reservations ['a3926b3b-3853-4013-bda3-7e4e7c494eb5', '982e021a-57a6-46de-9b5a-2a387918abec', '1df14633-aaa8-4c06-8e55-1b02fd2f99e4', '1a16bc60-78db-4ab2-b30a-ab165d7dc45e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:32 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c620555-ca45-46a5-9c32-47a853035d71_mvpdcn0m Nov 01 09:13:32 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:32 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:32 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:33 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 1073741824" returned: 0 in 0.502s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c620555-ca45-46a5-9c32-47a853035d71_mvpdcn0m" returned: 0 in 0.413s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c620555-ca45-46a5-9c32-47a853035d71_mvpdcn0m {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.281s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:33 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Deleted volume successfully. Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-32284194-dba3-4d87-a843-12ff5516b24b tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-b196af9e-45ca-45a4-a6ea-58602782d6e8-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 Nov 01 09:13:33 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:33 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c620555-ca45-46a5-9c32-47a853035d71_mvpdcn0m Nov 01 09:13:33 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:33 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.920s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Creating offline snapshot 0095508d-9166-480f-80ee-51161d2247c4 of volume 08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:13:33 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c620555-ca45-46a5-9c32-47a853035d71_mvpdcn0m" returned: 1 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c620555-ca45-46a5-9c32-47a853035d71_mvpdcn0m' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Attempting download of 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'metadata': {}}])) to volume 2c80bb70-6186-4e36-8e71-3f913c565683. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b03968-46ea-4ef9-a006-c24cb74c93e2]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[36306126-1424-4e5f-8b64-a232fb9f8a0b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b2c13f-5c34-4dbe-ae8e-1202421849c2]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_f9jiwwjh {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD Nov 01 09:13:33 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:33 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 Nov 01 09:13:33 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:33 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_f9jiwwjh Nov 01 09:13:33 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:33 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_f9jiwwjh" returned: 0 in 0.398s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_f9jiwwjh {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:33 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 1G Nov 01 09:13:33 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-47b2950b-1a62-401b-b1f4-d9e214f97232-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-47b2950b-1a62-401b-b1f4-d9e214f97232-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:34 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD Nov 01 09:13:34 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-quobyte-47b2950b-1a62-401b-b1f4-d9e214f97232" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-47b2950b-1a62-401b-b1f4-d9e214f97232" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:34 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_f9jiwwjh Nov 01 09:13:34 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[43710b07-d745-4f51-9409-09f935c2ea45]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 Nov 01 09:13:34 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] 7c620555-ca45-46a5-9c32-47a853035d71 was raw, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_f9jiwwjh" returned: 1 in 0.451s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_f9jiwwjh' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fcbf64-b216-405d-ab9e-61882cf6f6bd]: (4, 'raw') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe Nov 01 09:13:34 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 1G" returned: 0 in 0.549s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08da9e03-b9c7-4a0c-a806-406c30637623 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08da9e03-b9c7-4a0c-a806-406c30637623 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 Nov 01 09:13:34 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD Nov 01 09:13:34 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232" returned: 0 in 0.460s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232 Nov 01 09:13:34 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08da9e03-b9c7-4a0c-a806-406c30637623 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4" returned: 0 in 0.349s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 is being set with open permissions: ugo+rw Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 Nov 01 09:13:34 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-47b2950b-1a62-401b-b1f4-d9e214f97232" returned: 0 in 0.315s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:34 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD Nov 01 09:13:34 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-47b2950b-1a62-401b-b1f4-d9e214f97232" released by "delete_volume" :: held 0.837s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe" returned: 0 in 0.564s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c620555-ca45-46a5-9c32-47a853035d71_vc9v_j2_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:13:34 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:13:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:34 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe 1G Nov 01 09:13:34 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Created reservations ['f210b1de-6238-4c19-b356-84e6936fd5c3', 'c0717008-c5d4-4526-a2fc-e0e3ba811399', '0ee22e8c-c88b-4f63-a806-baf09e2b4b5d', '16fa3ef8-4e1a-4655-b991-f913aea3a377'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:35 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:35 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:35 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4" returned: 0 in 0.377s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:35 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 was raw, converting to qcow2 {{(pid=86770) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-a49c36ce-160b-4235-9c4c-71bd202863e1-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:35 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 Nov 01 09:13:35 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-a49c36ce-160b-4235-9c4c-71bd202863e1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:35 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.info Nov 01 09:13:35 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-quobyte-a49c36ce-160b-4235-9c4c-71bd202863e1" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-a49c36ce-160b-4235-9c4c-71bd202863e1" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:35 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe 1G" returned: 0 in 0.506s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Downloaded image 7c620555-ca45-46a5-9c32-47a853035d71 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c620555-ca45-46a5-9c32-47a853035d71', 'metadata': {}}])) to volume e35440fa-684a-4860-803d-150979685afe successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Temporary image 7c620555-ca45-46a5-9c32-47a853035d71 for user 14a3c97dedd2441588ba1ce5045f4d1a is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Marking volume e35440fa-684a-4860-803d-150979685afe as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2a97ac-7a77-4c30-bf27-8c5cc46b0dbf]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Copying metadata from image 7c620555-ca45-46a5-9c32-47a853035d71 to e35440fa-684a-4860-803d-150979685afe. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Creating volume glance metadata for volume e35440fa-684a-4860-803d-150979685afe backed by image 7c620555-ca45-46a5-9c32-47a853035d71 with: {'image_id': '7c620555-ca45-46a5-9c32-47a853035d71', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b98a87534b59ab64acd3b1d70dccb7e9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:13:35 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.475s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Deleted volume successfully. Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8270833-8cd4-4ec6-a715-5f95de1384db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35440fa-684a-4860-803d-150979685afe', 'volume_size': 1, 'image_id': '7c620555-ca45-46a5-9c32-47a853035d71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c620555-ca45-46a5-9c32-47a853035d71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b98a87534b59ab64acd3b1d70dccb7e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfb2be7d9fcc468791243c81081aab54', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dadd645e87dcc6b67e86c559fb889635c2310638b57aba85a1978fae874274292f62111dbb3d908c3a7aa7b126f0fe7082961a57cdd3fa276012e5b21f38902b', 'id': '7c620555-ca45-46a5-9c32-47a853035d71', 'created_at': datetime.datetime(2026, 11, 1, 8, 13, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 13, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c620555-ca45-46a5-9c32-47a853035d71/file', 'properties': {}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621b87e1-1dac-4960-8262-bf8d56e7bd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f00d61f1-5ef6-42d6-982c-da793d0e1430 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-47b2950b-1a62-401b-b1f4-d9e214f97232-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:35 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Volume volume-e35440fa-684a-4860-803d-150979685afe (e35440fa-684a-4860-803d-150979685afe): created successfully Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621b87e1-1dac-4960-8262-bf8d56e7bd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Flow 'volume_create_manager' (1af9eb96-ddcb-4b53-8100-efe9c943a4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:35 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 Nov 01 09:13:35 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-86298525-b22a-4d0d-b06e-6a3b6ef7401c tempest-VolumeImageDependencyTests-897007067 None] Created volume successfully. Nov 01 09:13:35 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.info" returned: 0 in 0.393s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:35 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.info is being set with open permissions: ugo+rw Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:35 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.info Nov 01 09:13:35 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:35 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683" returned: 0 in 0.644s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4be67b6b-a856-4bf1-b5a2-1c7effe7cb48_dc2nrfo8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:13:35 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:13:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:35 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 1G Nov 01 09:13:35 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:36 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1" returned: 0 in 0.525s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:36 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.info" returned: 0 in 0.299s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:36 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1 Nov 01 09:13:36 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-0366064e-2a27-4434-ad50-6987723363f6 tempest-CinderUnicodeTest-757181986 None] Create snapshot completed successfully Nov 01 09:13:36 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 1G" returned: 0 in 0.345s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Downloaded image 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 ((None, [{'url': 'file:///opt/stack/data/glance/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'metadata': {}}])) to volume 2c80bb70-6186-4e36-8e71-3f913c565683 successfully. {{(pid=86770) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Temporary image 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 for user 6612eb43ab80407784bebecbaae381fb is deleted. {{(pid=86770) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.volume_utils [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Marking volume 2c80bb70-6186-4e36-8e71-3f913c565683 as bootable. {{(pid=86770) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Copying metadata from image 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 to 2c80bb70-6186-4e36-8e71-3f913c565683. {{(pid=86770) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Creating volume glance metadata for volume 2c80bb70-6186-4e36-8e71-3f913c565683 backed by image 4be67b6b-a856-4bf1-b5a2-1c7effe7cb48 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c5797ac936dd82230a6239c422044e92', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86770) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:13:36 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a49c36ce-160b-4235-9c4c-71bd202863e1" returned: 0 in 0.288s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-a49c36ce-160b-4235-9c4c-71bd202863e1" released by "delete_volume" :: held 0.886s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc40536-a498-4cac-867f-604700aec9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c80bb70-6186-4e36-8e71-3f913c565683', 'volume_size': 1, 'image_id': '4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5797ac936dd82230a6239c422044e92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1a239807518f4859bdc38c6039c293af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0ecc468e51e97f287c3098ff4e0d3c64da9dc7d5a60e70386cdbf8f5685ffd5ab619a5db281044092dfd95ae80a90face629dc18a2fe027c0d35c13ec1f1c86', 'id': '4be67b6b-a856-4bf1-b5a2-1c7effe7cb48', 'created_at': datetime.datetime(2026, 11, 1, 8, 13, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 13, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4be67b6b-a856-4bf1-b5a2-1c7effe7cb48/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412c32c0-57c6-4178-be22-c33758ef13b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:36 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Volume volume-2c80bb70-6186-4e36-8e71-3f913c565683 (2c80bb70-6186-4e36-8e71-3f913c565683): created successfully Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412c32c0-57c6-4178-be22-c33758ef13b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Flow 'volume_create_manager' (401c67e9-0656-4174-a867-8dacc94000a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Created reservations ['3a7ce377-9301-45e0-9fbb-6976c2ae7534', 'e8f442b7-d0a3-41cb-8dbf-d897122f406c', '6b907154-cc2d-4c27-9e96-afa47fcaa5e8', '8df2f11f-6a7b-47da-84f5-329eacd0c704'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7dcb7ca2-6fa8-4ea3-8c3f-563f6773bee5 tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Created volume successfully. Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:36 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:36 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Acquiring lock "cinder-e35440fa-684a-4860-803d-150979685afe-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Lock "cinder-e35440fa-684a-4860-803d-150979685afe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Acquiring lock "cinder-quobyte-e35440fa-684a-4860-803d-150979685afe" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Lock "cinder-quobyte-e35440fa-684a-4860-803d-150979685afe" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:36 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.309s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f092dc-24ce-4e28-87fc-8eee85b048ef]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:36 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Deleted volume successfully. Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Acquiring lock "cinder-0095508d-9166-480f-80ee-51161d2247c4-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7a105e9b-7e2f-4a46-93c0-8e793d33a907 tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-a49c36ce-160b-4235-9c4c-71bd202863e1-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Lock "cinder-0095508d-9166-480f-80ee-51161d2247c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Acquiring lock "cinder-quobyte-08da9e03-b9c7-4a0c-a806-406c30637623" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-08da9e03-b9c7-4a0c-a806-406c30637623" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Acquiring lock "cinder-quobyte-0095508d-9166-480f-80ee-51161d2247c4" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-0095508d-9166-480f-80ee-51161d2247c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Deleting offline snapshot 0095508d-9166-480f-80ee-51161d2247c4 of volume 08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] snapshot_file for this snap is: volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cca9062-1173-4df3-9f43-3bdc42c8ed81]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:36 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe Nov 01 09:13:36 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:37 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 Nov 01 09:13:37 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:37 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe" returned: 0 in 0.411s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:37 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe Nov 01 09:13:37 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:37 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08da9e03-b9c7-4a0c-a806-406c30637623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7607662-ab7d-4003-bdac-77edeb170a19]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Acquiring lock "cinder-2c80bb70-6186-4e36-8e71-3f913c565683-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:37 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "cinder-2c80bb70-6186-4e36-8e71-3f913c565683-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:37 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:37 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e35440fa-684a-4860-803d-150979685afe" returned: 0 in 0.318s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Acquiring lock "cinder-quobyte-2c80bb70-6186-4e36-8e71-3f913c565683" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Lock "cinder-quobyte-e35440fa-684a-4860-803d-150979685afe" released by "delete_volume" :: held 0.822s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "cinder-quobyte-2c80bb70-6186-4e36-8e71-3f913c565683" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-cbe3db20-a6b3-49e7-b3a3-720e7af66985-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-cbe3db20-a6b3-49e7-b3a3-720e7af66985-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa7c5ee-ba7f-4b3e-8572-61fd726f9845]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Created reservations ['3c982f97-c679-471b-8b3a-7947c948a074', 'ef5168a5-b27d-4bba-8787-0601384b4b58', 'a8be9791-1761-4a2f-8296-522326722f4b', '1e88e085-e75f-493e-9736-75c1ed2e6654'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-quobyte-cbe3db20-a6b3-49e7-b3a3-720e7af66985" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-cbe3db20-a6b3-49e7-b3a3-720e7af66985" acquired by "delete_volume" :: waited 0.033s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[77988a3c-a605-4f95-aecb-6a9725a2b991]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:37 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:37 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 Nov 01 09:13:37 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623" returned: 0 in 0.469s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:37 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 Nov 01 09:13:37 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:37 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:37 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:37 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 Nov 01 09:13:37 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:38 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683" returned: 0 in 0.507s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:38 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683 Nov 01 09:13:38 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:38 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Deleted volume successfully. Nov 01 09:13:38 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d15271b1-25c0-4387-9ac5-ec5fe60cc5af tempest-VolumeImageDependencyTests-897007067 None] Lock "cinder-e35440fa-684a-4860-803d-150979685afe-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985" returned: 0 in 0.540s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:38 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985 Nov 01 09:13:38 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4" returned: 0 in 0.554s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:38 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4 Nov 01 09:13:38 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:38 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-2c80bb70-6186-4e36-8e71-3f913c565683" returned: 0 in 0.295s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "cinder-quobyte-2c80bb70-6186-4e36-8e71-3f913c565683" released by "delete_volume" :: held 0.886s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Created reservations ['8b21daa3-6c10-4c53-98dc-fb95ea153213', '818d3e35-e753-43b5-8b77-28dd7b90ce15', '783ffcfa-0a48-48fd-bab1-e9d2130fa804', 'ced2ae2b-5ca4-4cae-82e9-04cb3a6c16f8'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:38 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:38 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:38 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-cbe3db20-a6b3-49e7-b3a3-720e7af66985" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-cbe3db20-a6b3-49e7-b3a3-720e7af66985" released by "delete_volume" :: held 0.991s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:38 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623.0095508d-9166-480f-80ee-51161d2247c4" returned: 0 in 0.410s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-0095508d-9166-480f-80ee-51161d2247c4" released by "_delete_snapshot" :: held 1.971s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-08da9e03-b9c7-4a0c-a806-406c30637623" released by "delete_snapshot" :: held 1.994s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Created reservations ['88c8f671-0b33-4752-8173-336ef512e91c', '56deafec-1f49-4415-a195-a6bc5e4538d0', 'e155a63c-e54c-425c-8da0-654f3cd61a42', '096f9cac-8eb5-4912-b882-b890da83208a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Created reservations ['b3468d96-a923-43bb-9583-e72fceb6342a', 'd0c27e54-3aae-437e-ac36-823bc233e9d9', 'ac6edcfa-8a3e-4f5b-845d-67f7b50c5d34', '30db9019-423c-42fe-8ab3-3d2b38ee534e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:38 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Deleted volume successfully. Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-8d4e8dc9-e301-412d-8863-e711064b9dad tempest-VolumeAndVolumeTypeFromImageTest-1631431545 None] Lock "cinder-2c80bb70-6186-4e36-8e71-3f913c565683-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:39 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:39 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Delete snapshot completed successfully. Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e404d76a-14e6-4225-9b1c-a8b9b620ccfc tempest-CinderUnicodeTest-757181986 None] Lock "cinder-0095508d-9166-480f-80ee-51161d2247c4-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:39 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.328s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Deleted volume successfully. Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a9d7181-91cc-4763-b4ff-a000cabaa5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-cbe3db20-a6b3-49e7-b3a3-720e7af66985-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-a3cb311a-b103-4227-85b5-5d9da83b703e-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-a3cb311a-b103-4227-85b5-5d9da83b703e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "cinder-quobyte-a3cb311a-b103-4227-85b5-5d9da83b703e" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-a3cb311a-b103-4227-85b5-5d9da83b703e" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf45dd85-26c5-40cb-887b-c12d3da447f2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Acquiring lock "cinder-08da9e03-b9c7-4a0c-a806-406c30637623-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Lock "cinder-08da9e03-b9c7-4a0c-a806-406c30637623-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Acquiring lock "cinder-quobyte-08da9e03-b9c7-4a0c-a806-406c30637623" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-08da9e03-b9c7-4a0c-a806-406c30637623" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:40 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e Nov 01 09:13:40 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7157a625-973b-4eca-8deb-bc4799ade5f6]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:40 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 Nov 01 09:13:40 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:40 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e" returned: 0 in 0.458s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:40 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e Nov 01 09:13:40 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:40 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623" returned: 0 in 0.433s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:40 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623 Nov 01 09:13:40 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:40 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a3cb311a-b103-4227-85b5-5d9da83b703e" returned: 0 in 0.371s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-quobyte-a3cb311a-b103-4227-85b5-5d9da83b703e" released by "delete_volume" :: held 0.894s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Created reservations ['af186878-5786-4852-9fad-5c5c55a8f5e0', '5d49ea79-0185-4fe7-a7f1-6bb95d64a169', '6767fb62-e4e5-45b6-84d2-59ff2202e473', '2933d31d-ad00-41f4-810b-6108cdd5d75d'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:41 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-08da9e03-b9c7-4a0c-a806-406c30637623" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-08da9e03-b9c7-4a0c-a806-406c30637623" released by "delete_volume" :: held 0.879s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Created reservations ['400b2772-c576-4218-b58c-09bf6a380ca8', '4c7a809b-d646-461a-85c2-fd2859d603b6', '41b2d2f1-5191-4a24-aa8d-1d4979f36db1', '054dc5f0-e985-4990-b978-f44a39a6bfc7'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:41 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:41 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:41 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:41 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "cinder-5a6d5112-d386-45e2-8268-11c6e9e7f69c-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Lock "cinder-5a6d5112-d386-45e2-8268-11c6e9e7f69c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "cinder-quobyte-5a6d5112-d386-45e2-8268-11c6e9e7f69c" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-5a6d5112-d386-45e2-8268-11c6e9e7f69c" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff517efa-c744-44e2-aa0f-09e7636a0ba2]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:41 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.367s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Deleted volume successfully. Nov 01 09:13:41 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.522s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Deleted volume successfully. Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c2e9139c-9a1a-4328-bfc3-c314a8b02ecd tempest-CinderUnicodeTest-757181986 None] Lock "cinder-08da9e03-b9c7-4a0c-a806-406c30637623-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:41 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c Nov 01 09:13:41 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3b27865-36ca-41bc-b561-63c619c6e5af tempest-CreateVolumesFromImageTest-2020743230 None] Lock "cinder-a3cb311a-b103-4227-85b5-5d9da83b703e-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:42 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c" returned: 0 in 0.425s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:42 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c Nov 01 09:13:42 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:42 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a6d5112-d386-45e2-8268-11c6e9e7f69c" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Lock "cinder-quobyte-5a6d5112-d386-45e2-8268-11c6e9e7f69c" released by "delete_volume" :: held 0.895s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Created reservations ['dfcedacc-61d3-4e61-9c04-ea538a77088c', '6e6e3b86-e6b0-4590-b717-a3798ebb2d89', '426e3426-69fb-4f6c-9425-27ba658821fb', '3e8e464c-100e-49b0-b657-1d3c91898317'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:42 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:42 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:42 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.307s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:42 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Deleted volume successfully. Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1c2998b5-79ee-46f2-bbba-a3b6b27bb180 tempest-CinderUnicodeTest-757181986 None] Lock "cinder-5a6d5112-d386-45e2-8268-11c6e9e7f69c-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (10eee03b-fede-4895-bfc8-32c314b40c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2898bb-5011-47e4-a4cc-8f05e94f326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2898bb-5011-47e4-a4cc-8f05e94f326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141477413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e2d6ac-9554-4a76-9c03-2b15be353ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:44Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7605bd3a-5595-4ca4-b491-5dfed9070b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7605bd3a-5595-4ca4-b491-5dfed9070b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae1af1-bcd7-4aaa-a0b0-149d0dc50a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae1af1-bcd7-4aaa-a0b0-149d0dc50a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e2d6ac-9554-4a76-9c03-2b15be353ef5', 'volume_name': 'volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061fdbfb-59c6-4ab0-845f-35f19897f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061fdbfb-59c6-4ab0-845f-35f19897f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1bc071-329b-4915-aeb6-b4f1c643cb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:43 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Volume c5e2d6ac-9554-4a76-9c03-2b15be353ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5', 'volume_size': 1} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141477413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e2d6ac-9554-4a76-9c03-2b15be353ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:44Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Creating volume c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:43 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:43 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 1073741824 Nov 01 09:13:43 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:44 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 1073741824" returned: 0 in 0.512s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:44 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 Nov 01 09:13:44 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:44 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" returned: 0 in 0.342s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1bc071-329b-4915-aeb6-b4f1c643cb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a023078b-bdc4-407b-b834-4a2b83f9d2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:44 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Volume volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 (c5e2d6ac-9554-4a76-9c03-2b15be353ef5): created successfully Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a023078b-bdc4-407b-b834-4a2b83f9d2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:44 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (10eee03b-fede-4895-bfc8-32c314b40c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:44 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-fba6b697-2e50-462f-b4bd-710ed80b1c64 tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (c6ec5dbc-12e9-45e1-a504-32d02479d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c431daf5-fb67-41a5-9f7a-aa0249160ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c431daf5-fb67-41a5-9f7a-aa0249160ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090990460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cfa60a-c8ce-42d2-aa4c-d78b311316a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:45Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c52992-e65a-41a4-8d58-aee8613fe198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c52992-e65a-41a4-8d58-aee8613fe198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327979d2-81b8-41e3-b9cb-0a3a89a9221b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327979d2-81b8-41e3-b9cb-0a3a89a9221b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88cfa60a-c8ce-42d2-aa4c-d78b311316a6', 'volume_name': 'volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb01a56-7b97-478e-84d9-d7e6318813ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb01a56-7b97-478e-84d9-d7e6318813ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0c3ed2-135b-4ae1-8f6d-4f6740c75d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:45 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume 88cfa60a-c8ce-42d2-aa4c-d78b311316a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6', 'volume_size': 1} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2090990460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88cfa60a-c8ce-42d2-aa4c-d78b311316a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:45Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Creating volume 88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:45 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:45 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 1073741824 Nov 01 09:13:45 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:45 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:45 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 1073741824" returned: 0 in 0.623s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:46 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 Nov 01 09:13:46 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (40aef421-fb78-45bc-afa5-efcc6c94aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115f73b1-07cc-4c4f-9419-9acf9f9f0c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115f73b1-07cc-4c4f-9419-9acf9f9f0c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871621870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349f5882-551a-4912-8fa3-fc22cc0eae67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:46Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98838873-5288-4d65-bbe3-0fe347c8a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98838873-5288-4d65-bbe3-0fe347c8a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4bd9a4-316c-4560-a8a7-071c14d729b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4bd9a4-316c-4560-a8a7-071c14d729b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349f5882-551a-4912-8fa3-fc22cc0eae67', 'volume_name': 'volume-349f5882-551a-4912-8fa3-fc22cc0eae67', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:46 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9575bdb6-d024-4fcf-8ba7-020766319cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9575bdb6-d024-4fcf-8ba7-020766319cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d49c4f-bccd-4cbd-b303-c552d7ece15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:46 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume 349f5882-551a-4912-8fa3-fc22cc0eae67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349f5882-551a-4912-8fa3-fc22cc0eae67', 'volume_size': 1} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-871621870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349f5882-551a-4912-8fa3-fc22cc0eae67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:46Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Creating volume 349f5882-551a-4912-8fa3-fc22cc0eae67 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:46 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0c3ed2-135b-4ae1-8f6d-4f6740c75d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517a6601-f659-47d4-96d6-496485d660c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:46 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 1073741824 Nov 01 09:13:46 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:46 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 (88cfa60a-c8ce-42d2-aa4c-d78b311316a6): created successfully Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517a6601-f659-47d4-96d6-496485d660c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (c6ec5dbc-12e9-45e1-a504-32d02479d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:46 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-549ba70d-a081-475f-acf2-018be7526040 tempest-CreateVolumesFromSnapshotTest-107205810 None] Created volume successfully. Nov 01 09:13:46 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 1073741824" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:46 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:46 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 Nov 01 09:13:46 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:47 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.716s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d49c4f-bccd-4cbd-b303-c552d7ece15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349f5882-551a-4912-8fa3-fc22cc0eae67', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9074c6-0ecc-406b-bb80-cc319d6e02d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot 556c8d6b-750a-4516-8343-5a18896a6e86 of volume c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:13:47 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume volume-349f5882-551a-4912-8fa3-fc22cc0eae67 (349f5882-551a-4912-8fa3-fc22cc0eae67): created successfully Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9074c6-0ecc-406b-bb80-cc319d6e02d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (40aef421-fb78-45bc-afa5-efcc6c94aea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42dc60-1691-4384-9e83-8da75300454a]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:47 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1d2b7912-b4cb-4884-af86-a00033f2e9aa tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created volume successfully. Nov 01 09:13:47 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 Nov 01 09:13:47 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:47 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" returned: 0 in 0.442s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:47 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:47 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 1G Nov 01 09:13:47 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:48 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 1G" returned: 0 in 0.479s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:48 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 Nov 01 09:13:48 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:48 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86" returned: 0 in 0.326s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:48 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 is being set with open permissions: ugo+rw Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:48 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 Nov 01 09:13:48 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (ec498558-b78b-4a6c-bf88-ecf210c038ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7b66d8-bee6-42df-a730-bcaa77fd0f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:48 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86" returned: 0 in 0.293s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7b66d8-bee6-42df-a730-bcaa77fd0f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887797448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfc3d29-7ff1-427c-b24b-a9b54d89257c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:49Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0813410-2281-48b4-81e8-c4200145ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0813410-2281-48b4-81e8-c4200145ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddaae6d-ee9e-49c9-93c3-c4a8b6ab7745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddaae6d-ee9e-49c9-93c3-c4a8b6ab7745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfc3d29-7ff1-427c-b24b-a9b54d89257c', 'volume_name': 'volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217a7839-62a0-4958-8cde-dfb0a656d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217a7839-62a0-4958-8cde-dfb0a656d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d78828-4276-432e-8136-5f0d5cf17999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:48 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume 1cfc3d29-7ff1-427c-b24b-a9b54d89257c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c', 'volume_size': 1} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:48 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.info Nov 01 09:13:48 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:49 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (68ae25a2-3db9-4f2c-a2cf-6fb2147e7f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6567b0-182d-4c6c-bdce-b23baab962d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.info" returned: 0 in 0.310s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:49 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.info is being set with open permissions: ugo+rw Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6567b0-182d-4c6c-bdce-b23baab962d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529926554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d17819-475a-4f40-b98c-4b389284cb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:49Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17620f6-8e97-4642-91f1-21332a009a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.info Nov 01 09:13:49 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17620f6-8e97-4642-91f1-21332a009a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b1c04a-ebba-4ef8-9f28-8d0022d7a307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b1c04a-ebba-4ef8-9f28-8d0022d7a307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d17819-475a-4f40-b98c-4b389284cb2c', 'volume_name': 'volume-22d17819-475a-4f40-b98c-4b389284cb2c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852c30b5-9c2a-47db-b8d1-4439c1c4be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852c30b5-9c2a-47db-b8d1-4439c1c4be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd4951a-495f-4643-8bf7-4b167870ec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume 22d17819-475a-4f40-b98c-4b389284cb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d17819-475a-4f40-b98c-4b389284cb2c', 'volume_size': 1} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:49 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.info" returned: 0 in 0.337s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.943s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Creating offline snapshot 8153175a-cea3-4586-8b7c-9c6913312102 of volume 88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (d7446d53-fc40-42d7-b505-23e484bfa3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b840ad04-e27d-47be-8bd6-c35e3c41b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2957192a-820d-4c81-b5c2-017865ccafba]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9c16cbb9-0c0a-4c53-a968-8031f278d484 tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b840ad04-e27d-47be-8bd6-c35e3c41b58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1616725890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1080994d-6857-4b49-b268-ef1038ee0ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:49Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b163b2-fdff-42d5-a061-dd7fafad8b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2b163b2-fdff-42d5-a061-dd7fafad8b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7689f5-e903-4c80-b860-5c4aa753ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7689f5-e903-4c80-b860-5c4aa753ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1080994d-6857-4b49-b268-ef1038ee0ee3', 'volume_name': 'volume-1080994d-6857-4b49-b268-ef1038ee0ee3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb01b1f-a9c2-4272-8845-2fcdce0ceb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb01b1f-a9c2-4272-8845-2fcdce0ceb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40763cb-75d6-4513-ac1f-616c87cd351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume 1080994d-6857-4b49-b268-ef1038ee0ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1080994d-6857-4b49-b268-ef1038ee0ee3', 'volume_size': 1} Nov 01 09:13:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:49 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 Nov 01 09:13:49 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (94dfa9a6-439d-4952-ba0a-10f1867b0b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce50f77a-36af-4156-bc69-93eb858c25a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce50f77a-36af-4156-bc69-93eb858c25a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245013155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8d87fd-725f-4ded-bc76-6b2171b5bb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:50Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d49a237-2eb6-4567-be0d-7698dacc8282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d49a237-2eb6-4567-be0d-7698dacc8282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3a37f7-2b5d-4635-8d58-a589e4e535a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3a37f7-2b5d-4635-8d58-a589e4e535a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8d87fd-725f-4ded-bc76-6b2171b5bb21', 'volume_name': 'volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a11865-ead4-4997-b4bc-122b62b1828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90a11865-ead4-4997-b4bc-122b62b1828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e89e424-2cfe-457d-8ff9-bae9e46b7f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume 5a8d87fd-725f-4ded-bc76-6b2171b5bb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21', 'volume_size': 1} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:50 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" returned: 0 in 0.501s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:50 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 1G Nov 01 09:13:50 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (b36e2c25-d00e-4267-b0fd-52950416677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfdef17-2583-4b93-bc38-b7b3f1c39279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfdef17-2583-4b93-bc38-b7b3f1c39279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833274696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b195b93-f572-4946-a4cd-b12a244bf830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:50Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c35dff-41c4-4666-9b1c-5f3a8e32b20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c35dff-41c4-4666-9b1c-5f3a8e32b20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecd5f01-3ceb-4fe2-85d0-03d6d583a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecd5f01-3ceb-4fe2-85d0-03d6d583a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b195b93-f572-4946-a4cd-b12a244bf830', 'volume_name': 'volume-8b195b93-f572-4946-a4cd-b12a244bf830', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd0df0c-02fc-4990-a150-d909a6404be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd0df0c-02fc-4990-a150-d909a6404be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb502a9-2999-4c26-829a-ef804efc7238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:50 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume 8b195b93-f572-4946-a4cd-b12a244bf830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b195b93-f572-4946-a4cd-b12a244bf830', 'volume_size': 1} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-556c8d6b-750a-4516-8343-5a18896a6e86-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Lock "cinder-556c8d6b-750a-4516-8343-5a18896a6e86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-556c8d6b-750a-4516-8343-5a18896a6e86" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-556c8d6b-750a-4516-8343-5a18896a6e86" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:50 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot 556c8d6b-750a-4516-8343-5a18896a6e86 of volume c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 1G" returned: 0 in 0.577s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[48737845-9e8f-4d35-b693-bc58e2eeb562]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:50 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 Nov 01 09:13:50 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:50 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 Nov 01 09:13:50 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:51 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102" returned: 0 in 0.290s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:51 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 is being set with open permissions: ugo+rw Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:51 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 Nov 01 09:13:51 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86" returned: 0 in 0.383s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:13:51 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ff2134-0fc3-4268-9d33-ee115b59ff41]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:51 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 Nov 01 09:13:51 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:51 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102" returned: 0 in 0.253s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:51 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.info Nov 01 09:13:51 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:51 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:51 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:51 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 Nov 01 09:13:51 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.info" returned: 0 in 0.307s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:51 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.info is being set with open permissions: ugo+rw Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:51 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.info Nov 01 09:13:51 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:51 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.info" returned: 0 in 0.306s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.130s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887797448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfc3d29-7ff1-427c-b24b-a9b54d89257c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:49Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Creating volume 1cfc3d29-7ff1-427c-b24b-a9b54d89257c {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:51 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:52 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:52 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86" returned: 0 in 0.395s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:52 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c 1073741824 Nov 01 09:13:52 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:52 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86 Nov 01 09:13:52 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e7f0eaf1-4e63-40ca-8a8f-c62456971476 tempest-CreateVolumesFromSnapshotTest-107205810 None] Create snapshot completed successfully Nov 01 09:13:52 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5.556c8d6b-750a-4516-8343-5a18896a6e86" returned: 0 in 0.286s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-556c8d6b-750a-4516-8343-5a18896a6e86" released by "_delete_snapshot" :: held 1.643s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" released by "delete_snapshot" :: held 1.666s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Created reservations ['185168df-c284-4364-b0ad-545a33b5c35f', 'c59ba533-8902-4bb0-97b6-c544fa82d2c9', '42596157-d450-47d4-96bc-248acb76a165', '50df716f-3c64-4202-88ec-07e1ae66af18'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:52 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-dfee1d5f-c6d8-4c21-ba85-d51ce5faa32a tempest-ProjectMemberTests-1799352219 None] Lock "cinder-556c8d6b-750a-4516-8343-5a18896a6e86-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:52 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c 1073741824" returned: 0 in 0.586s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:52 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c Nov 01 09:13:52 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-c5e2d6ac-9554-4a76-9c03-2b15be353ef5-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-c5e2d6ac-9554-4a76-9c03-2b15be353ef5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:52 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c" returned: 0 in 0.261s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.634s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529926554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d17819-475a-4f40-b98c-4b389284cb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:49Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Creating volume 22d17819-475a-4f40-b98c-4b389284cb2c {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:52 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d78828-4276-432e-8136-5f0d5cf17999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:52 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c 1073741824 Nov 01 09:13:52 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dff9e5-637a-4503-aae8-46a233830ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" acquired by "delete_volume" :: waited 0.062s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:53 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c (1cfc3d29-7ff1-427c-b24b-a9b54d89257c): created successfully Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dff9e5-637a-4503-aae8-46a233830ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (ec498558-b78b-4a6c-bf88-ecf210c038ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9fdb0b-f495-4dfd-9157-3f6f8b9b3593]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b353adef-2553-4092-985a-65b74a65ac91 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created volume successfully. Nov 01 09:13:53 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 Nov 01 09:13:53 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:53 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" returned: 0 in 0.424s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:53 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c 1073741824" returned: 0 in 0.564s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:53 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5 Nov 01 09:13:53 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (2acd27fd-0555-4378-ab79-80c00f251f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e8b158-23d2-468e-8e64-fa9812762afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:53 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c Nov 01 09:13:53 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e8b158-23d2-468e-8e64-fa9812762afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-489066483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341f7e1a-999b-44fc-8508-a80a8d932385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:53Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834d9873-5857-4444-9497-9e75213f5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834d9873-5857-4444-9497-9e75213f5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322098b6-48e4-40e6-a775-aa1fe9d89b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322098b6-48e4-40e6-a775-aa1fe9d89b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341f7e1a-999b-44fc-8508-a80a8d932385', 'volume_name': 'volume-341f7e1a-999b-44fc-8508-a80a8d932385', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d4b8ff-598b-48d1-8bdc-1ca2bfec7548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d4b8ff-598b-48d1-8bdc-1ca2bfec7548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68009e5e-31aa-48b4-910c-146127ae654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:53 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume 341f7e1a-999b-44fc-8508-a80a8d932385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341f7e1a-999b-44fc-8508-a80a8d932385', 'volume_size': 1} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:53 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" returned: 0 in 0.455s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c5e2d6ac-9554-4a76-9c03-2b15be353ef5" released by "delete_volume" :: held 0.997s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:54 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c" returned: 0 in 0.467s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1616725890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1080994d-6857-4b49-b268-ef1038ee0ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:49Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Creating volume 1080994d-6857-4b49-b268-ef1038ee0ee3 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:54 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:54 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 1073741824 Nov 01 09:13:54 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (1f72ff4e-efa7-417f-a534-c8ea5f1b5928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1662cf58-8e1f-4776-a274-dc6f2250cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd4951a-495f-4643-8bf7-4b167870ec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d17819-475a-4f40-b98c-4b389284cb2c', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61987d4-a798-4ff5-93a6-77eac3746449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Created reservations ['bb9c1efc-bd68-46b8-a0ec-ec46d6cb2690', '0fbf2175-a81f-48c3-9c38-8b5ee6db0685', '15f8e978-1d5c-4760-a768-660f0087ea40', 'ff1e2b34-5765-42f1-ad33-b4092f6ecc25'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1662cf58-8e1f-4776-a274-dc6f2250cd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800177895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8f669d-7fa6-4ddc-9983-a783b3224e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:54Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555d85e6-2b14-4d04-bd02-ff3888a7f4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555d85e6-2b14-4d04-bd02-ff3888a7f4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537bcb8d-c7c1-462b-891d-20413040fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537bcb8d-c7c1-462b-891d-20413040fd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8f669d-7fa6-4ddc-9983-a783b3224e3f', 'volume_name': 'volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513286d6-57b4-4203-adb1-8c6483c6913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513286d6-57b4-4203-adb1-8c6483c6913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19721864-1f87-4495-baad-b1732f6cb26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume fb8f669d-7fa6-4ddc-9983-a783b3224e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f', 'volume_size': 1} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:54 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume volume-22d17819-475a-4f40-b98c-4b389284cb2c (22d17819-475a-4f40-b98c-4b389284cb2c): created successfully Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61987d4-a798-4ff5-93a6-77eac3746449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (68ae25a2-3db9-4f2c-a2cf-6fb2147e7f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2249a7c8-f27e-4324-998e-6053b96a270b tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created volume successfully. Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:54 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:54 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (8c961751-a7dd-409b-aac9-37f81ef9ebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c49d91-cfef-4200-b12e-7e41454939f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c49d91-cfef-4200-b12e-7e41454939f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920302247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8e0a61-935b-4322-8f14-57969c0f5a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:54Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48111c9a-d660-43b0-b813-f60469d715af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48111c9a-d660-43b0-b813-f60469d715af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e6ddd1-7aaa-4fcd-8ebd-f5d99fe4b3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e6ddd1-7aaa-4fcd-8ebd-f5d99fe4b3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8e0a61-935b-4322-8f14-57969c0f5a23', 'volume_name': 'volume-eb8e0a61-935b-4322-8f14-57969c0f5a23', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4132c804-d496-430f-b57a-001ee76b5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4132c804-d496-430f-b57a-001ee76b5e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e145f7a0-e89b-42ec-898b-22428e0c2ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:54 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume eb8e0a61-935b-4322-8f14-57969c0f5a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8e0a61-935b-4322-8f14-57969c0f5a23', 'volume_size': 1} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 1073741824" returned: 0 in 0.687s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:54 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.466s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-a0b0d546-dd77-4ce4-a5e0-45b97266a50f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-c5e2d6ac-9554-4a76-9c03-2b15be353ef5-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:54 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 Nov 01 09:13:54 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:55 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3" returned: 0 in 0.407s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.109s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1245013155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8d87fd-725f-4ded-bc76-6b2171b5bb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:50Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Creating volume 5a8d87fd-725f-4ded-bc76-6b2171b5bb21 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:55 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:55 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 1073741824 Nov 01 09:13:55 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40763cb-75d6-4513-ac1f-616c87cd351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1080994d-6857-4b49-b268-ef1038ee0ee3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3335c29-3da4-4f8e-964d-8ecf5fe2b782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume volume-1080994d-6857-4b49-b268-ef1038ee0ee3 (1080994d-6857-4b49-b268-ef1038ee0ee3): created successfully Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3335c29-3da4-4f8e-964d-8ecf5fe2b782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (d7446d53-fc40-42d7-b505-23e484bfa3c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (eb404d3c-6d56-424e-b70a-cf74942d8090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a183b28f-dafd-43a1-8723-3b2d950d7311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6d6e4df5-0e57-4451-a2f9-3410ca1fde9a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created volume successfully. Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a183b28f-dafd-43a1-8723-3b2d950d7311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056212970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29947c3-5132-4cbb-9723-10b5baee3b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:55Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d1c289-bb7d-418b-ad96-0c30b92e7b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d1c289-bb7d-418b-ad96-0c30b92e7b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38aef345-1847-4461-8e9a-20eb2de6750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38aef345-1847-4461-8e9a-20eb2de6750b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29947c3-5132-4cbb-9723-10b5baee3b54', 'volume_name': 'volume-c29947c3-5132-4cbb-9723-10b5baee3b54', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd03f01b-d9f6-4eeb-9798-d916fcaa91ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd03f01b-d9f6-4eeb-9798-d916fcaa91ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44f4e6c-e0e3-4483-a864-90301282f8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Volume c29947c3-5132-4cbb-9723-10b5baee3b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29947c3-5132-4cbb-9723-10b5baee3b54', 'volume_size': 1} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (f4316a2e-d2ca-4c44-a527-6b47cf39a7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc13fb3c-edbe-4176-8edc-58e348d78a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc13fb3c-edbe-4176-8edc-58e348d78a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4470150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fe4b3a-5f5b-44f4-a223-3bc8449545b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:55Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbd8372-d7e9-437a-8d41-bcb4173a0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbd8372-d7e9-437a-8d41-bcb4173a0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c005f02f-a501-4d19-8a71-5b435a7d1f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c005f02f-a501-4d19-8a71-5b435a7d1f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17fe4b3a-5f5b-44f4-a223-3bc8449545b6', 'volume_name': 'volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a648fdc-e210-401c-b78d-0cb70b893a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a648fdc-e210-401c-b78d-0cb70b893a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cf7945-b8d2-4c69-954d-6ab4fb4db4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:55 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume 17fe4b3a-5f5b-44f4-a223-3bc8449545b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6', 'volume_size': 1} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:55 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 1073741824" returned: 0 in 0.616s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:55 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 Nov 01 09:13:55 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (142c00ce-ba94-434f-b5e8-bf2b2448645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf9524-efc1-49f5-8dcd-2752a14bb709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf9524-efc1-49f5-8dcd-2752a14bb709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942164536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e74aa8-4772-4460-b790-43c61ed6824f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:56Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f48a880-35b6-4e2b-ba25-5e40823abe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f48a880-35b6-4e2b-ba25-5e40823abe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5740a62-7dac-4f93-a8c9-22150441ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5740a62-7dac-4f93-a8c9-22150441ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e74aa8-4772-4460-b790-43c61ed6824f', 'volume_name': 'volume-04e74aa8-4772-4460-b790-43c61ed6824f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4c781d-b88f-4e3f-af7d-96dc4b75d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4c781d-b88f-4e3f-af7d-96dc4b75d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a8cf15-5951-435d-808e-8e586aab7f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:56 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume 04e74aa8-4772-4460-b790-43c61ed6824f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e74aa8-4772-4460-b790-43c61ed6824f', 'volume_size': 1} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:56 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21" returned: 0 in 0.278s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.518s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-833274696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b195b93-f572-4946-a4cd-b12a244bf830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93b00d4c7b6467fbc9bffcc5542a929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:50Z,use_quota=True,user_id='d4dbeb0dbd1048b4801b32b3210b4222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Creating volume 8b195b93-f572-4946-a4cd-b12a244bf830 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:56 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e89e424-2cfe-457d-8ff9-bae9e46b7f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b294491a-8639-4bea-bfa4-a402b06b7384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:56 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 1073741824 Nov 01 09:13:56 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:56 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 (5a8d87fd-725f-4ded-bc76-6b2171b5bb21): created successfully Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b294491a-8639-4bea-bfa4-a402b06b7384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (94dfa9a6-439d-4952-ba0a-10f1867b0b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ab417692-77ab-4f62-b85d-8b303947117a tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created volume successfully. Nov 01 09:13:56 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 1073741824" returned: 0 in 0.524s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:56 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 Nov 01 09:13:56 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:57 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.353s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-489066483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341f7e1a-999b-44fc-8508-a80a8d932385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:53Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Creating volume 341f7e1a-999b-44fc-8508-a80a8d932385 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:57 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb502a9-2999-4c26-829a-ef804efc7238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b195b93-f572-4946-a4cd-b12a244bf830', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:57 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 1073741824 Nov 01 09:13:57 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e4ebc2-4489-4513-9725-629336660ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:57 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Volume volume-8b195b93-f572-4946-a4cd-b12a244bf830 (8b195b93-f572-4946-a4cd-b12a244bf830): created successfully Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e4ebc2-4489-4513-9725-629336660ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Flow 'volume_create_manager' (b36e2c25-d00e-4267-b0fd-52950416677a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c5ad9792-e9e2-438e-9bf2-515ea7758e06 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created volume successfully. Nov 01 09:13:57 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 1073741824" returned: 0 in 0.455s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:57 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 Nov 01 09:13:57 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-8b195b93-f572-4946-a4cd-b12a244bf830-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-8b195b93-f572-4946-a4cd-b12a244bf830-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-quobyte-8b195b93-f572-4946-a4cd-b12a244bf830" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-8b195b93-f572-4946-a4cd-b12a244bf830" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566f5a6-7292-4950-b83d-de61db6202c0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:57 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385" returned: 0 in 0.299s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.670s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800177895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8f669d-7fa6-4ddc-9983-a783b3224e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:54Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Creating volume fb8f669d-7fa6-4ddc-9983-a783b3224e3f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:57 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:57 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 Nov 01 09:13:57 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:57 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f 1073741824 Nov 01 09:13:57 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68009e5e-31aa-48b4-910c-146127ae654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341f7e1a-999b-44fc-8508-a80a8d932385', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dba5a5c-5bd0-453c-bedc-b70335d7ffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:57 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume volume-341f7e1a-999b-44fc-8508-a80a8d932385 (341f7e1a-999b-44fc-8508-a80a8d932385): created successfully Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dba5a5c-5bd0-453c-bedc-b70335d7ffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (2acd27fd-0555-4378-ab79-80c00f251f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e20c05e6-54e8-40b3-90e4-f6d7209ca726 tempest-CreateVolumesFromSnapshotTest-107205810 None] Created volume successfully. Nov 01 09:13:58 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830" returned: 0 in 0.492s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:58 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830 Nov 01 09:13:58 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:58 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f 1073741824" returned: 0 in 0.568s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:58 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f Nov 01 09:13:58 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:58 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-8b195b93-f572-4946-a4cd-b12a244bf830" returned: 0 in 0.347s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-8b195b93-f572-4946-a4cd-b12a244bf830" released by "delete_volume" :: held 0.905s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created reservations ['ab99e49e-a650-4271-9dfa-a88a1affb748', 'e00188bc-ef5d-4af0-8302-a0c83041d117', '116dd810-d589-4d5c-8ba9-bb6e39c1f1ed', '4fddc53c-3acb-4f64-92ed-85430cbc1d1b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:58 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f" returned: 0 in 0.332s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.099s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920302247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8e0a61-935b-4322-8f14-57969c0f5a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:54Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Creating volume eb8e0a61-935b-4322-8f14-57969c0f5a23 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:58 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:58 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:13:58 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-5a8d87fd-725f-4ded-bc76-6b2171b5bb21-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:58 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 1073741824 Nov 01 09:13:58 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19721864-1f87-4495-baad-b1732f6cb26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde6d7df-8839-4565-9e8f-70a8bc3f675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:58 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f (fb8f669d-7fa6-4ddc-9983-a783b3224e3f): created successfully Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde6d7df-8839-4565-9e8f-70a8bc3f675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (1f72ff4e-efa7-417f-a534-c8ea5f1b5928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-5a8d87fd-725f-4ded-bc76-6b2171b5bb21-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:58 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-747233ba-4336-4221-a0a6-2d08d7bd292d tempest-CreateVolumesFromSnapshotTest-107205810 None] Created volume successfully. Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-quobyte-5a8d87fd-725f-4ded-bc76-6b2171b5bb21" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-5a8d87fd-725f-4ded-bc76-6b2171b5bb21" acquired by "delete_volume" :: waited 0.040s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5d20f-3520-4700-8bde-34959ddcfed9]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:59 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:13:59 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Deleted volume successfully. Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c9bb345-067e-4759-9c1a-25d7e7819964 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-8b195b93-f572-4946-a4cd-b12a244bf830-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:59 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 Nov 01 09:13:59 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:59 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 1073741824" returned: 0 in 0.686s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:59 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 Nov 01 09:13:59 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:59 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21" returned: 0 in 0.535s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:59 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21 Nov 01 09:13:59 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:59 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23" returned: 0 in 0.272s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.390s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2056212970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29947c3-5132-4cbb-9723-10b5baee3b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:55Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Creating volume c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:13:59 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e145f7a0-e89b-42ec-898b-22428e0c2ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8e0a61-935b-4322-8f14-57969c0f5a23', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721be443-470c-4852-a699-df21c45b1e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:13:59 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 1073741824 Nov 01 09:13:59 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:13:59 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a8d87fd-725f-4ded-bc76-6b2171b5bb21" returned: 0 in 0.279s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:13:59 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 (eb8e0a61-935b-4322-8f14-57969c0f5a23): created successfully Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721be443-470c-4852-a699-df21c45b1e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (8c961751-a7dd-409b-aac9-37f81ef9ebfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:13:59 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-5a8d87fd-725f-4ded-bc76-6b2171b5bb21" released by "delete_volume" :: held 0.899s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:13:59 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-818aa503-d128-4b56-9c4f-b45d7d03a01d tempest-CreateVolumesFromSnapshotTest-107205810 None] Created volume successfully. Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created reservations ['06e16afd-a8f2-4a76-ad41-b7eb0665468d', '1f4af7a9-e791-4989-b01e-08cdc78d4ec1', 'a82bcfd1-8a6e-4c7f-8bc4-8cb5eeeca4c9', 'e140a021-b5cc-425f-ae6e-ce2a195f0ee4'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:00 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:00 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:00 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:00 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.314s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 1073741824" returned: 0 in 0.558s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Deleted volume successfully. Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-eba58851-7034-4789-987b-3e98bab79176 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-5a8d87fd-725f-4ded-bc76-6b2171b5bb21-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:00 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 Nov 01 09:14:00 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:00 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54" returned: 0 in 0.312s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.181s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4470150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fe4b3a-5f5b-44f4-a223-3bc8449545b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:55Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Creating volume 17fe4b3a-5f5b-44f4-a223-3bc8449545b6 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:00 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44f4e6c-e0e3-4483-a864-90301282f8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29947c3-5132-4cbb-9723-10b5baee3b54', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:00 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 1073741824 Nov 01 09:14:00 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9601e4a8-c7d1-4a56-9720-ab717572bd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Volume volume-c29947c3-5132-4cbb-9723-10b5baee3b54 (c29947c3-5132-4cbb-9723-10b5baee3b54): created successfully Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9601e4a8-c7d1-4a56-9720-ab717572bd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (eb404d3c-6d56-424e-b70a-cf74942d8090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-194d948c-7e3e-4bfd-ada9-d4e1cc728629 tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-1080994d-6857-4b49-b268-ef1038ee0ee3-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-1080994d-6857-4b49-b268-ef1038ee0ee3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-quobyte-1080994d-6857-4b49-b268-ef1038ee0ee3" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-1080994d-6857-4b49-b268-ef1038ee0ee3" acquired by "delete_volume" :: waited 0.028s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3f0834-a3e0-45d5-a612-9b7277979844]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:01 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 1073741824" returned: 0 in 0.556s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:01 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 Nov 01 09:14:01 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:01 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 Nov 01 09:14:01 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:01 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6" returned: 0 in 0.377s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.762s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942164536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e74aa8-4772-4460-b790-43c61ed6824f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274bc243674b4d4a835ac026d1e215af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:13:56Z,use_quota=True,user_id='2ecaf26cfdd64c2bae1b1a615e1947c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Creating volume 04e74aa8-4772-4460-b790-43c61ed6824f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:01 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:01 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3" returned: 0 in 0.510s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:01 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f 1073741824 Nov 01 09:14:01 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cf7945-b8d2-4c69-954d-6ab4fb4db4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cc0b4d-4954-4e61-b519-de471213438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:01 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3 Nov 01 09:14:01 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:01 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 (17fe4b3a-5f5b-44f4-a223-3bc8449545b6): created successfully Nov 01 09:14:01 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cc0b4d-4954-4e61-b519-de471213438d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (f4316a2e-d2ca-4c44-a527-6b47cf39a7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1375e3ba-3c22-494b-bac0-4b3bb66f8256 tempest-CreateVolumesFromSnapshotTest-107205810 None] Created volume successfully. Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:02 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1080994d-6857-4b49-b268-ef1038ee0ee3" returned: 0 in 0.390s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-1080994d-6857-4b49-b268-ef1038ee0ee3" released by "delete_volume" :: held 0.950s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created reservations ['bb0c916f-e99a-4bd0-b638-059778462354', '5d54ed8e-3f0e-466a-9d98-ac704205db0a', 'f3e7f5aa-6bd5-4a85-8f50-7375578b1bc0', '64d645f7-1e0a-4d58-8a71-4a2599c88611'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:02 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:02 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:02 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f 1073741824" returned: 0 in 0.721s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:02 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f Nov 01 09:14:02 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:02 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.369s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Deleted volume successfully. Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-41e5efa7-543a-46d6-9e19-423aa451f474 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-1080994d-6857-4b49-b268-ef1038ee0ee3-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:02 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f" returned: 0 in 0.330s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.917s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot 0a44490d-9391-4f46-a197-f80453909560 of volume c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a8cf15-5951-435d-808e-8e586aab7f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e74aa8-4772-4460-b790-43c61ed6824f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410d8836-4e0b-4021-bcda-ad88e6b56ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b9656d-b88f-4169-8be9-3b569cc2dc47]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:03 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Volume volume-04e74aa8-4772-4460-b790-43c61ed6824f (04e74aa8-4772-4460-b790-43c61ed6824f): created successfully Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410d8836-4e0b-4021-bcda-ad88e6b56ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Flow 'volume_create_manager' (142c00ce-ba94-434f-b5e8-bf2b2448645c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3a4d9a9c-4825-4f89-a50a-a873e6946036 tempest-CreateVolumesFromSnapshotTest-107205810 None] Created volume successfully. Nov 01 09:14:03 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 Nov 01 09:14:03 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:03 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54" returned: 0 in 0.476s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-22d17819-475a-4f40-b98c-4b389284cb2c-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:03 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 1G Nov 01 09:14:03 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-22d17819-475a-4f40-b98c-4b389284cb2c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-quobyte-22d17819-475a-4f40-b98c-4b389284cb2c" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-22d17819-475a-4f40-b98c-4b389284cb2c" acquired by "delete_volume" :: waited 0.034s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaa3ee4-1f32-4abd-bf6b-5d545c662373]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-04e74aa8-4772-4460-b790-43c61ed6824f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-04e74aa8-4772-4460-b790-43c61ed6824f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:04 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c Nov 01 09:14:04 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-04e74aa8-4772-4460-b790-43c61ed6824f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-04e74aa8-4772-4460-b790-43c61ed6824f" acquired by "delete_volume" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[281d3558-b387-46ce-8f1a-4bc97fedb160]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:04 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 1G" returned: 0 in 0.800s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29947c3-5132-4cbb-9723-10b5baee3b54 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:04 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f Nov 01 09:14:04 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:04 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29947c3-5132-4cbb-9723-10b5baee3b54 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 Nov 01 09:14:04 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:04 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c" returned: 0 in 0.634s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:04 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c Nov 01 09:14:04 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:04 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f" returned: 0 in 0.565s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:04 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f Nov 01 09:14:04 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:04 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-22d17819-475a-4f40-b98c-4b389284cb2c" returned: 0 in 0.336s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:04 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c29947c3-5132-4cbb-9723-10b5baee3b54 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560" returned: 0 in 0.451s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:04 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 is being set with open permissions: ugo+rw Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-22d17819-475a-4f40-b98c-4b389284cb2c" released by "delete_volume" :: held 1.092s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:04 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 Nov 01 09:14:04 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created reservations ['b6a5a97d-a864-457c-9ef5-56a48ed4e4f1', '229d32b2-30c8-4b2b-9d57-d7785280af03', '8d40717a-3adc-4f9c-9def-24736b2b45ad', 'd3288fc7-8cbf-4c40-b1f0-58b9962be024'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:04 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:04 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:04 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-04e74aa8-4772-4460-b790-43c61ed6824f" returned: 0 in 0.312s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-04e74aa8-4772-4460-b790-43c61ed6824f" released by "delete_volume" :: held 0.952s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Created reservations ['ef769ec2-f187-4252-9368-586607b94a8f', '6375f85d-9ba1-4596-bbfd-534cca7ca610', 'a6bb5e56-18d6-4758-b34c-ded1cada3e65', '738861ca-8091-4ea4-8f61-e7f786732d0b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:05 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560" returned: 0 in 0.391s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:05 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.info Nov 01 09:14:05 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:05 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Deleted volume successfully. Nov 01 09:14:05 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:05 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bfdfdb-fa12-44a3-a991-fb83dec489a1 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-22d17819-475a-4f40-b98c-4b389284cb2c-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:05 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.info" returned: 0 in 0.300s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:05 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.info is being set with open permissions: ugo+rw Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:05 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.info Nov 01 09:14:05 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:05 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.306s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Deleted volume successfully. Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bae9a141-75f2-42d6-8760-8a470498bc2c tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-04e74aa8-4772-4460-b790-43c61ed6824f-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:05 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.info" returned: 0 in 0.277s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-1cfc3d29-7ff1-427c-b24b-a9b54d89257c-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3c127b47-4521-411f-81ee-4328174a1408 tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-1cfc3d29-7ff1-427c-b24b-a9b54d89257c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-quobyte-1cfc3d29-7ff1-427c-b24b-a9b54d89257c" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-1cfc3d29-7ff1-427c-b24b-a9b54d89257c" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bc5b34-dd6a-43ba-9135-29a2f4925738]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:06 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c Nov 01 09:14:06 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-0a44490d-9391-4f46-a197-f80453909560-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-0a44490d-9391-4f46-a197-f80453909560-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-c29947c3-5132-4cbb-9723-10b5baee3b54" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-17fe4b3a-5f5b-44f4-a223-3bc8449545b6-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-17fe4b3a-5f5b-44f4-a223-3bc8449545b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c29947c3-5132-4cbb-9723-10b5baee3b54" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-0a44490d-9391-4f46-a197-f80453909560" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-0a44490d-9391-4f46-a197-f80453909560" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot 0a44490d-9391-4f46-a197-f80453909560 of volume c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-17fe4b3a-5f5b-44f4-a223-3bc8449545b6" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:06 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c" returned: 0 in 0.505s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00db8b1-4485-47ca-a5d6-20ac7f3dc37f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-17fe4b3a-5f5b-44f4-a223-3bc8449545b6" acquired by "delete_volume" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:06 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c Nov 01 09:14:06 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c009424-2114-4e4d-b58e-3cded3e1b90e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:06 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 Nov 01 09:14:06 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:06 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 Nov 01 09:14:06 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:06 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1cfc3d29-7ff1-427c-b24b-a9b54d89257c" returned: 0 in 0.430s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-1cfc3d29-7ff1-427c-b24b-a9b54d89257c" released by "delete_volume" :: held 0.994s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created reservations ['3a553889-b624-448d-8236-1055bcd9ca37', '38dfa595-9aac-48a2-a75b-d39508aaa7bc', 'ada3a7ca-6c9a-4c35-bf28-3db740597a71', 'c570a1e1-242f-4b8e-901d-173e502eb6b2'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:07 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560" returned: 0 in 0.541s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c29947c3-5132-4cbb-9723-10b5baee3b54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e20f64-104c-40cb-9260-7af2b7137efe]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:07 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6" returned: 0 in 0.578s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:07 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6 Nov 01 09:14:07 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:07 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:07 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:07 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 Nov 01 09:14:07 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:07 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-17fe4b3a-5f5b-44f4-a223-3bc8449545b6" returned: 0 in 0.302s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-17fe4b3a-5f5b-44f4-a223-3bc8449545b6" released by "delete_volume" :: held 0.952s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Created reservations ['2742c32f-1f1a-42f6-a8db-7031dbcecc95', 'be7b0d69-ff8e-4705-8a49-4c4e51f29432', '0692c5fa-873c-49e7-bfbb-f7aa660f1cdf', '4228cc22-8a5c-40b1-8fcd-9f455bd0ae8f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:07 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.457s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Deleted volume successfully. Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-99d8a70c-6a5c-40e8-929d-364d6d25517f tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-1cfc3d29-7ff1-427c-b24b-a9b54d89257c-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:07 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:07 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:07 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54" returned: 0 in 0.675s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:07 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 Nov 01 09:14:07 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:07 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.286s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Deleted volume successfully. Nov 01 09:14:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-925c1125-6818-4db3-b59d-910df11cddd1 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-17fe4b3a-5f5b-44f4-a223-3bc8449545b6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-349f5882-551a-4912-8fa3-fc22cc0eae67-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-349f5882-551a-4912-8fa3-fc22cc0eae67-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:08 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560" returned: 0 in 0.442s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:08 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560 Nov 01 09:14:08 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "cinder-quobyte-349f5882-551a-4912-8fa3-fc22cc0eae67" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-349f5882-551a-4912-8fa3-fc22cc0eae67" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22475d7-5e22-4d99-a6e9-9c7105f58b5c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:08 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54.0a44490d-9391-4f46-a197-f80453909560" returned: 0 in 0.309s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:08 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 Nov 01 09:14:08 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-0a44490d-9391-4f46-a197-f80453909560" released by "_delete_snapshot" :: held 2.189s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c29947c3-5132-4cbb-9723-10b5baee3b54" released by "delete_snapshot" :: held 2.227s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Created reservations ['3fc28430-5333-4786-b851-823f8f79a752', 'dc94df06-fb91-4154-858e-2e6152f4cda4', '6f2ce195-b343-4087-8ba7-1ae9c7b77ea5', 'e544065b-cd50-491a-8819-12a3d87ed29b'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-eb8e0a61-935b-4322-8f14-57969c0f5a23-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-eb8e0a61-935b-4322-8f14-57969c0f5a23-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:08 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-eb8e0a61-935b-4322-8f14-57969c0f5a23" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f7d2aa72-c035-4270-9f8e-0dac0b785bc2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-0a44490d-9391-4f46-a197-f80453909560-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-eb8e0a61-935b-4322-8f14-57969c0f5a23" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac420a-ef15-48ff-8118-6e1d1b88fdd0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:08 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67" returned: 0 in 0.508s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:08 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67 Nov 01 09:14:08 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:08 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 Nov 01 09:14:08 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:09 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-349f5882-551a-4912-8fa3-fc22cc0eae67" returned: 0 in 0.279s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-quobyte-349f5882-551a-4912-8fa3-fc22cc0eae67" released by "delete_volume" :: held 0.852s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Created reservations ['6482a714-9eb2-4c4c-8ade-4d19a5d6d91f', 'b533b870-88f2-40ef-af1d-a9cc15c72e34', '372be58d-f6ec-42ca-93da-47cf66c01114', '443693dc-c2c5-4641-9bdd-92a07ce46beb'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:09 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23" returned: 0 in 0.422s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:09 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23 Nov 01 09:14:09 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:09 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:09 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:09 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-eb8e0a61-935b-4322-8f14-57969c0f5a23" returned: 0 in 0.383s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-eb8e0a61-935b-4322-8f14-57969c0f5a23" released by "delete_volume" :: held 0.855s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:09 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.341s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Deleted volume successfully. Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-c29947c3-5132-4cbb-9723-10b5baee3b54-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-3c55a846-11f8-45d4-8bcc-d72fa348fc82 tempest-CreateVolumesFromSourceVolumeTest-1576021915 None] Lock "cinder-349f5882-551a-4912-8fa3-fc22cc0eae67-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-c29947c3-5132-4cbb-9723-10b5baee3b54-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Created reservations ['f94d54ba-388d-4709-9a3a-144a142ee192', '2a12aabe-fe86-4441-b9df-412fc25555ab', '0efe1ca0-504b-45cf-8c77-8ccf567e629c', 'aa8f7c83-694f-42c3-bc87-a95d934a9649'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-c29947c3-5132-4cbb-9723-10b5baee3b54" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c29947c3-5132-4cbb-9723-10b5baee3b54" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beca328-3a19-4272-9542-e7ec69559cf0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:10 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:10 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:10 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 Nov 01 09:14:10 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:10 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.315s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:10 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Deleted volume successfully. Nov 01 09:14:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-daa499d2-f92e-4deb-b877-85848f67a306 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-eb8e0a61-935b-4322-8f14-57969c0f5a23-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:10 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54" returned: 0 in 0.495s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:10 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54 Nov 01 09:14:10 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:10 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-c29947c3-5132-4cbb-9723-10b5baee3b54" returned: 0 in 0.385s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c29947c3-5132-4cbb-9723-10b5baee3b54" released by "delete_volume" :: held 1.018s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Created reservations ['6b06cb71-047c-4091-a9be-a56006cd463a', '2eae3bf0-9b60-4383-9174-e195aff6ef8e', '84a99f07-8bff-4778-9bfc-28895afe5c19', '03ec41a4-280f-472c-9a91-e5cdd2720477'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-fb8f669d-7fa6-4ddc-9983-a783b3224e3f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-fb8f669d-7fa6-4ddc-9983-a783b3224e3f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-fb8f669d-7fa6-4ddc-9983-a783b3224e3f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-fb8f669d-7fa6-4ddc-9983-a783b3224e3f" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:11 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:11 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f619e2-d6a8-49f9-ba6d-ba9446e4c68d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:11 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f Nov 01 09:14:11 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:11 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.428s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b46659d6-ea3f-42f0-b568-899906991371 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-c29947c3-5132-4cbb-9723-10b5baee3b54-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:11 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f" returned: 0 in 0.514s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:11 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f Nov 01 09:14:11 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:12 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-fb8f669d-7fa6-4ddc-9983-a783b3224e3f" returned: 0 in 0.314s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-fb8f669d-7fa6-4ddc-9983-a783b3224e3f" released by "delete_volume" :: held 0.888s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Created reservations ['d05ce90a-a9a7-4b8e-9dbb-204174a3dcde', '18662d72-4527-42ee-88fe-bdf8174b7307', 'e19f14b1-7d8c-4aad-80ca-edda5dc33d43', '35bffc27-732d-4e40-8bb1-0732ce523f10'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:12 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:12 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:12 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:12 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Deleted volume successfully. Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9b66f490-923c-42ee-be01-7e2b1a22794d tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-fb8f669d-7fa6-4ddc-9983-a783b3224e3f-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (9e752a2e-ffeb-4992-b2fa-5d196710bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b23c9-8d81-441a-aac1-eb9022b27876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b23c9-8d81-441a-aac1-eb9022b27876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141216301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dd275d-53d8-4219-834d-cb441d576a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:13Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b3b49-7add-435d-b01a-896787f9b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b3b49-7add-435d-b01a-896787f9b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05237646-51a4-4960-9382-20dd1651948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05237646-51a4-4960-9382-20dd1651948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54dd275d-53d8-4219-834d-cb441d576a1f', 'volume_name': 'volume-54dd275d-53d8-4219-834d-cb441d576a1f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99bb404-9ed5-4e43-a945-414373f4b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99bb404-9ed5-4e43-a945-414373f4b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5eae1b-e349-4021-9a6c-a09c699d01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:12 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Volume 54dd275d-53d8-4219-834d-cb441d576a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54dd275d-53d8-4219-834d-cb441d576a1f', 'volume_size': 1} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141216301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dd275d-53d8-4219-834d-cb441d576a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:13Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Creating volume 54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:12 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:12 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f 1073741824 Nov 01 09:14:12 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-341f7e1a-999b-44fc-8508-a80a8d932385-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-341f7e1a-999b-44fc-8508-a80a8d932385-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:13 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f 1073741824" returned: 0 in 0.593s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-341f7e1a-999b-44fc-8508-a80a8d932385" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-341f7e1a-999b-44fc-8508-a80a8d932385" acquired by "delete_volume" :: waited 0.036s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:13 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f Nov 01 09:14:13 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3037257-2259-428d-abda-cdffd08e31e5]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:13 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 Nov 01 09:14:13 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Flow 'volume_create_manager' (26983e82-b8c2-4a75-8a7a-eb222656b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc5f597-2ba8-4fe3-a236-d0eb2c33c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc5f597-2ba8-4fe3-a236-d0eb2c33c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1904362000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069aa268-0da6-4334-b59a-759abd035772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534d1a156e974d09b5840fb239ee33d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:14Z,use_quota=True,user_id='f5133290220c41f0a429ef7ac7958f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d46861-b346-42f1-beeb-6dfc82812c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d46861-b346-42f1-beeb-6dfc82812c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46da1cdc-7ff9-46f6-ab00-5028bfff9c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46da1cdc-7ff9-46f6-ab00-5028bfff9c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069aa268-0da6-4334-b59a-759abd035772', 'volume_name': 'volume-069aa268-0da6-4334-b59a-759abd035772', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8260ad6a-8a5a-4444-a5ba-635cb2fe6fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8260ad6a-8a5a-4444-a5ba-635cb2fe6fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b79a41-61a2-406b-8c5e-11b2c3750493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:14 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Volume 069aa268-0da6-4334-b59a-759abd035772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069aa268-0da6-4334-b59a-759abd035772', 'volume_size': 1} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:14 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1904362000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069aa268-0da6-4334-b59a-759abd035772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534d1a156e974d09b5840fb239ee33d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:14Z,use_quota=True,user_id='f5133290220c41f0a429ef7ac7958f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Creating volume 069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:14 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5eae1b-e349-4021-9a6c-a09c699d01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54dd275d-53d8-4219-834d-cb441d576a1f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0ebc7c-3d35-4450-a0b1-bbef81a05e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:14 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 1073741824 Nov 01 09:14:14 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:14 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Volume volume-54dd275d-53d8-4219-834d-cb441d576a1f (54dd275d-53d8-4219-834d-cb441d576a1f): created successfully Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0ebc7c-3d35-4450-a0b1-bbef81a05e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (9e752a2e-ffeb-4992-b2fa-5d196710bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:14 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-bd6b72e5-4846-41b0-92d1-86d6cb735a24 tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:14:14 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385" returned: 0 in 0.554s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:14 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385 Nov 01 09:14:14 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:14 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-341f7e1a-999b-44fc-8508-a80a8d932385" returned: 0 in 0.313s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-341f7e1a-999b-44fc-8508-a80a8d932385" released by "delete_volume" :: held 0.970s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:14 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 1073741824" returned: 0 in 0.595s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Created reservations ['b5bcf0cf-3421-4f53-8f8e-bc38ca6145fd', 'a2c98d7c-87a6-49b4-828e-11f8974c9408', 'fa73d271-ca49-4356-b07c-54c19eec20d8', 'fc2f3b6f-ef8b-4c53-8f25-39f16cb4527f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:14 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:14 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:14 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:14 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:14 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772" returned: 0 in 0.282s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b79a41-61a2-406b-8c5e-11b2c3750493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069aa268-0da6-4334-b59a-759abd035772', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11172f8-835f-4c1a-91d9-ac210f88d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:15 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.302s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Deleted volume successfully. Nov 01 09:14:15 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Volume volume-069aa268-0da6-4334-b59a-759abd035772 (069aa268-0da6-4334-b59a-759abd035772): created successfully Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11172f8-835f-4c1a-91d9-ac210f88d32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Flow 'volume_create_manager' (26983e82-b8c2-4a75-8a7a-eb222656b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-290efb17-69c8-4d06-931d-516fd302ac40 tempest-VolumeDependencyTests-36913452 None] Created volume successfully. Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-328a8f13-67c4-4769-8ad6-20a3bacd9e0e tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-341f7e1a-999b-44fc-8508-a80a8d932385-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot 603de3e5-4f04-4e3f-afaf-3dd854d84d12 of volume 54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7acb572-96b3-4e4e-9ec6-fb2b66d2ac6c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:15 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f Nov 01 09:14:15 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:15 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f" returned: 0 in 0.459s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:15 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 1G Nov 01 09:14:15 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-8153175a-cea3-4586-8b7c-9c6913312102-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-8153175a-cea3-4586-8b7c-9c6913312102-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-8153175a-cea3-4586-8b7c-9c6913312102" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-8153175a-cea3-4586-8b7c-9c6913312102" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Deleting offline snapshot 8153175a-cea3-4586-8b7c-9c6913312102 of volume 88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] snapshot_file for this snap is: volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c0938a-0be8-4fd3-a729-b7ac2bc26d4b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:16 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 Nov 01 09:14:16 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:16 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 1G" returned: 0 in 0.590s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dd275d-53d8-4219-834d-cb441d576a1f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:16 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dd275d-53d8-4219-834d-cb441d576a1f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 Nov 01 09:14:16 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:16 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102" returned: 0 in 0.537s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7cb49b-2f04-4abf-88c8-6ba039889757]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:16 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 Nov 01 09:14:16 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:16 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dd275d-53d8-4219-834d-cb441d576a1f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:16 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 is being set with open permissions: ugo+rw Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:16 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 Nov 01 09:14:16 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:16 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" returned: 0 in 0.470s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:16 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12" returned: 0 in 0.296s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:16 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 Nov 01 09:14:16 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:17 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.info Nov 01 09:14:17 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:17 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.info" returned: 0 in 0.303s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:17 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.info is being set with open permissions: ugo+rw Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:17 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:17 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.info Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102" returned: 0 in 0.403s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:17 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:17 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102 Nov 01 09:14:17 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:17 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.info" returned: 0 in 0.271s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.229s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Creating offline snapshot 7c4a2131-1aa4-42ec-b433-4537a61b5d34 of volume 069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:14:17 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6.8153175a-cea3-4586-8b7c-9c6913312102" returned: 0 in 0.298s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3361ade-9f39-4cdb-b15c-e2aaa8e0ac42]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-6fba3617-25cf-4a35-9bb3-97880c8607af tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-8153175a-cea3-4586-8b7c-9c6913312102" released by "_delete_snapshot" :: held 1.877s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" released by "delete_snapshot" :: held 1.903s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Created reservations ['87b7a478-4a0c-44a4-9b7e-4d0fff929f91', '3bffd0a8-b7dd-487f-b4e0-cd5b3205c271', 'ceb29292-8be2-4c08-a308-820dbd18b5b3', '16ff2899-507f-4cd7-98bf-840979b15159'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:17 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 Nov 01 09:14:17 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Delete snapshot completed successfully. Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ac44227f-b00c-470e-8dcb-1661a19c4af3 tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-8153175a-cea3-4586-8b7c-9c6913312102-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-88cfa60a-c8ce-42d2-aa4c-d78b311316a6-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-88cfa60a-c8ce-42d2-aa4c-d78b311316a6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "cinder-quobyte-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" acquired by "delete_volume" :: waited 0.033s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:18 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772" returned: 0 in 0.568s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b72f42d-b84c-49e6-8869-3cd530030c00]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:18 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 1G Nov 01 09:14:18 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:18 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 Nov 01 09:14:18 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-603de3e5-4f04-4e3f-afaf-3dd854d84d12-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-603de3e5-4f04-4e3f-afaf-3dd854d84d12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-54dd275d-53d8-4219-834d-cb441d576a1f" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-54dd275d-53d8-4219-834d-cb441d576a1f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-603de3e5-4f04-4e3f-afaf-3dd854d84d12" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-603de3e5-4f04-4e3f-afaf-3dd854d84d12" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot 603de3e5-4f04-4e3f-afaf-3dd854d84d12 of volume 54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb401d48-c381-445b-97cf-9b0ac276f9af]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:18 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 Nov 01 09:14:18 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:18 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" returned: 0 in 0.517s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:18 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 1G" returned: 0 in 0.543s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-069aa268-0da6-4334-b59a-759abd035772 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:18 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6 Nov 01 09:14:18 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:18 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-069aa268-0da6-4334-b59a-759abd035772 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 Nov 01 09:14:18 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:19 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" returned: 0 in 0.344s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:19 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:19 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-069aa268-0da6-4334-b59a-759abd035772 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34" returned: 0 in 0.367s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12" returned: 0 in 0.513s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:19 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 is being set with open permissions: ugo+rw Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54dd275d-53d8-4219-834d-cb441d576a1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:19 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 Nov 01 09:14:19 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-quobyte-88cfa60a-c8ce-42d2-aa4c-d78b311316a6" released by "delete_volume" :: held 1.070s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99a9c62-5696-4bbc-990d-4105f1186f5f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Created reservations ['7a22ac42-843d-42aa-bd81-f268bd2acb6a', '455c3f9a-71d0-4662-a9c0-ebc58e61d280', '19059de8-11f2-405f-bc27-320358044cfd', '4b9728e4-dc9f-4b70-b18c-bf5503eb2458'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:19 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f Nov 01 09:14:19 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:19 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:19 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:19 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34" returned: 0 in 0.475s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:19 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.info Nov 01 09:14:19 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:19 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:19 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f" returned: 0 in 0.585s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Deleted volume successfully. Nov 01 09:14:19 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 Nov 01 09:14:19 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ee76ba08-9aed-43da-864d-8cd1b14631de tempest-CreateVolumesFromSnapshotTest-107205810 None] Lock "cinder-88cfa60a-c8ce-42d2-aa4c-d78b311316a6-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:20 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.info" returned: 0 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:20 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.info is being set with open permissions: ugo+rw Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:20 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.info Nov 01 09:14:20 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:20 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12" returned: 0 in 0.461s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:20 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12 Nov 01 09:14:20 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:20 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.info" returned: 0 in 0.329s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-85f2055c-0912-466b-8fca-53d56fd4eb4d tempest-VolumeDependencyTests-36913452 None] Create snapshot completed successfully Nov 01 09:14:20 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f.603de3e5-4f04-4e3f-afaf-3dd854d84d12" returned: 0 in 0.567s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-603de3e5-4f04-4e3f-afaf-3dd854d84d12" released by "_delete_snapshot" :: held 2.316s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-54dd275d-53d8-4219-834d-cb441d576a1f" released by "delete_snapshot" :: held 2.362s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Created reservations ['bc3bee09-af3e-4d45-8173-9916ed863384', '6c8f254f-d826-49e7-84e0-062bbf09d9b5', 'dae99a65-d5a7-4655-a96b-c80f6b3738ac', '2ab9ca5f-68bc-4623-ae7e-081357d43f0e'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:21 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-987b3671-2dc9-46d3-85a4-07c581d9afd1 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-603de3e5-4f04-4e3f-afaf-3dd854d84d12-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:21 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:21 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Flow 'volume_create_manager' (95c79ccb-3759-43e3-8f8e-a346b50c6b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e598a3-8448-4c13-bba3-bf9c976afdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e598a3-8448-4c13-bba3-bf9c976afdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1636987947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d937f48a-e61c-46d9-85d3-1e6c9e63b350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534d1a156e974d09b5840fb239ee33d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7c4a2131-1aa4-42ec-b433-4537a61b5d34,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:21Z,use_quota=True,user_id='f5133290220c41f0a429ef7ac7958f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62977b7-4ee9-4a77-a0d8-0316f12b9fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62977b7-4ee9-4a77-a0d8-0316f12b9fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcefd136-98d0-4a34-8253-ef192f438b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcefd136-98d0-4a34-8253-ef192f438b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd937f48a-e61c-46d9-85d3-1e6c9e63b350', 'volume_name': 'volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350', 'volume_size': 1, 'snapshot_id': '7c4a2131-1aa4-42ec-b433-4537a61b5d34'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327fc466-933a-4b40-9fad-51987a9b9f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327fc466-933a-4b40-9fad-51987a9b9f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25699b0f-ae04-419e-a722-118e31c5c100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:21 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Volume d937f48a-e61c-46d9-85d3-1e6c9e63b350: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350', 'volume_size': 1, 'snapshot_id': '7c4a2131-1aa4-42ec-b433-4537a61b5d34'} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-quobyte-7c4a2131-1aa4-42ec-b433-4537a61b5d34-d937f48a-e61c-46d9-85d3-1e6c9e63b350" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-7c4a2131-1aa4-42ec-b433-4537a61b5d34-d937f48a-e61c-46d9-85d3-1e6c9e63b350" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Creating volume d937f48a-e61c-46d9-85d3-1e6c9e63b350 from snapshot 7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-quobyte-d937f48a-e61c-46d9-85d3-1e6c9e63b350" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-d937f48a-e61c-46d9-85d3-1e6c9e63b350" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] snapshot: 7c4a2131-1aa4-42ec-b433-4537a61b5d34, volume: d937f48a-e61c-46d9-85d3-1e6c9e63b350, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=214,cinder:INSERT=76,cinder:UPDATE=301,cinder:DELETE=33 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78ecb48-4638-4bad-bad4-29a58383cdc7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-54dd275d-53d8-4219-834d-cb441d576a1f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-54dd275d-53d8-4219-834d-cb441d576a1f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:21 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=298,cinder:SELECT=236,cinder:DELETE=21,cinder:INSERT=86 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.468s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-54dd275d-53d8-4219-834d-cb441d576a1f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:21 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-54dd275d-53d8-4219-834d-cb441d576a1f" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:22 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 Nov 01 09:14:22 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dabc46d-b79e-4c44-b11e-52bbc735bc72]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:22 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f Nov 01 09:14:22 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:22 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34" returned: 0 in 0.619s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-069aa268-0da6-4334-b59a-759abd035772(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf24856-36c0-4b5e-96a7-ee5aa8f7b180]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:22 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f" returned: 0 in 0.487s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:22 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f Nov 01 09:14:22 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:22 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 Nov 01 09:14:22 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:22 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-54dd275d-53d8-4219-834d-cb441d576a1f" returned: 0 in 0.406s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:22 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772" returned: 0 in 0.556s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:14:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-54dd275d-53d8-4219-834d-cb441d576a1f" released by "delete_volume" :: held 1.010s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:23 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 Nov 01 09:14:23 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Created reservations ['d2524727-28ee-4900-a54a-608fb7bc30f2', '2706f9b8-213f-4491-a2bc-22f532ee5ef2', 'd7ede46b-4c95-42fe-b728-d7531f3b446a', '10859507-bc00-496d-b66a-3c8b80ec26b7'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:23 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:23 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:23 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.431s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:14:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5bbffc96-e4d3-4e80-a2ca-04c56e9d57f8 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-54dd275d-53d8-4219-834d-cb441d576a1f-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (ffc1480a-2337-46bd-97d1-65e31a92d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22078ce-b18f-4e49-9e12-e5692d31de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22078ce-b18f-4e49-9e12-e5692d31de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963859577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918f96c6-d6dc-4a52-be3b-e3d5ba561dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:25Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c12f50c-af43-45ba-a034-f3783282aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c12f50c-af43-45ba-a034-f3783282aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aed3a22-05d6-462c-93e6-e8aa4f5752c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aed3a22-05d6-462c-93e6-e8aa4f5752c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918f96c6-d6dc-4a52-be3b-e3d5ba561dc3', 'volume_name': 'volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9646139e-bf40-4b1b-96be-031d5c5d46ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9646139e-bf40-4b1b-96be-031d5c5d46ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334930b9-7c7f-4c17-ac0f-b8d29829140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Volume 918f96c6-d6dc-4a52-be3b-e3d5ba561dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3', 'volume_size': 1} Nov 01 09:14:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-19e1947c-1c7e-42ef-988d-612b32b042dd tempest-ProjectAdminTests-1456130764 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9201431274414, 'free_capacity_gb': 1773.9201431274414, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86770) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Flow 'volume_create_manager' (2d675692-6635-44e7-8eed-06b0cfce0e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee9ebe5-008e-495b-9763-9f9d2c6aeedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee9ebe5-008e-495b-9763-9f9d2c6aeedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1185579761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d385023a-e851-4c39-b325-ce4dc8d26607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f1ded2cced40c5b0b574e5f3413409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:27Z,use_quota=True,user_id='1669bfe844604a298d8b3491ca5d7a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a47d65a-2e89-4135-9331-417a572821fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a47d65a-2e89-4135-9331-417a572821fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e9f7cf-f34f-41e2-b241-251bdb9fca83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e9f7cf-f34f-41e2-b241-251bdb9fca83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd385023a-e851-4c39-b325-ce4dc8d26607', 'volume_name': 'volume-d385023a-e851-4c39-b325-ce4dc8d26607', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23019aca-81f5-4a57-824c-f73cb0af2600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23019aca-81f5-4a57-824c-f73cb0af2600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d210ebcf-8061-4938-bf7c-cfd927fa35fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:27 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Volume d385023a-e851-4c39-b325-ce4dc8d26607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d385023a-e851-4c39-b325-ce4dc8d26607', 'volume_size': 1} Nov 01 09:14:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:31 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350" returned: 0 in 8.431s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:14:31 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Converted 1024.00 MB image at 121.45 MB/s Nov 01 09:14:31 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 is being set with open permissions: ugo+rw Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:31 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 Nov 01 09:14:31 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:31 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350" returned: 0 in 0.289s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-d937f48a-e61c-46d9-85d3-1e6c9e63b350" released by "_copy_volume_from_snapshot" :: held 10.068s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-7c4a2131-1aa4-42ec-b433-4537a61b5d34-d937f48a-e61c-46d9-85d3-1e6c9e63b350" released by "_create_volume_from_snapshot" :: held 10.157s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.180s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.215s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963859577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918f96c6-d6dc-4a52-be3b-e3d5ba561dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:25Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Creating volume 918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:31 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:31 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 1073741824 Nov 01 09:14:31 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25699b0f-ae04-419e-a722-118e31c5c100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350', 'volume_size': 1, 'snapshot_id': '7c4a2131-1aa4-42ec-b433-4537a61b5d34'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffa49f7-2974-455c-b0d3-d0d792206f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:31 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Volume volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 (d937f48a-e61c-46d9-85d3-1e6c9e63b350): created successfully Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffa49f7-2974-455c-b0d3-d0d792206f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Flow 'volume_create_manager' (95c79ccb-3759-43e3-8f8e-a346b50c6b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-feea388d-1760-4544-99f1-02bffd3ad7c3 tempest-VolumeDependencyTests-36913452 None] Created volume successfully. Nov 01 09:14:32 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 1073741824" returned: 0 in 0.455s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:32 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 Nov 01 09:14:32 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-7c4a2131-1aa4-42ec-b433-4537a61b5d34-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-7c4a2131-1aa4-42ec-b433-4537a61b5d34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-quobyte-069aa268-0da6-4334-b59a-759abd035772" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-069aa268-0da6-4334-b59a-759abd035772" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-quobyte-7c4a2131-1aa4-42ec-b433-4537a61b5d34" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-7c4a2131-1aa4-42ec-b433-4537a61b5d34" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Deleting offline snapshot 7c4a2131-1aa4-42ec-b433-4537a61b5d34 of volume 069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] snapshot_file for this snap is: volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdecca09-3d2e-4b83-bef0-88a1ae81552c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:32 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.856s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1185579761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d385023a-e851-4c39-b325-ce4dc8d26607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f1ded2cced40c5b0b574e5f3413409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:27Z,use_quota=True,user_id='1669bfe844604a298d8b3491ca5d7a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Creating volume d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:32 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:32 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 1073741824 Nov 01 09:14:32 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334930b9-7c7f-4c17-ac0f-b8d29829140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a0b400-3621-46b8-996d-9d2575a3f4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:32 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Volume volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 (918f96c6-d6dc-4a52-be3b-e3d5ba561dc3): created successfully Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a0b400-3621-46b8-996d-9d2575a3f4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (ffc1480a-2337-46bd-97d1-65e31a92d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:32 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 Nov 01 09:14:32 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e5c511ed-575f-4c34-a642-94cb70b4cc04 tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:14:32 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34" returned: 0 in 0.477s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:32 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-069aa268-0da6-4334-b59a-759abd035772(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[461eac83-60b3-4b33-8730-990ecab99a69]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:33 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 1073741824" returned: 0 in 0.584s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:33 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 Nov 01 09:14:33 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:33 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 Nov 01 09:14:33 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:33 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607" returned: 0 in 0.261s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d210ebcf-8061-4938-bf7c-cfd927fa35fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d385023a-e851-4c39-b325-ce4dc8d26607', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5464074-7da6-43c8-a69b-807cd27b0ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:33 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Volume volume-d385023a-e851-4c39-b325-ce4dc8d26607 (d385023a-e851-4c39-b325-ce4dc8d26607): created successfully Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5464074-7da6-43c8-a69b-807cd27b0ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Flow 'volume_create_manager' (2d675692-6635-44e7-8eed-06b0cfce0e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:33 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d960be4e-4aea-4e2a-a6ad-80270f145b3f tempest-SnapshotDependencyTests-502225619 None] Created volume successfully. Nov 01 09:14:33 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772" returned: 0 in 0.581s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:33 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 Nov 01 09:14:33 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot 23fb716c-30b6-411a-a64f-89f22b427448 of volume 918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e306f5-5110-4980-8442-81c800448b67]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:33 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 Nov 01 09:14:33 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:34 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34" returned: 0 in 0.428s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:34 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34 Nov 01 09:14:34 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:34 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" returned: 0 in 0.440s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:34 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 1G Nov 01 09:14:34 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:34 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772.7c4a2131-1aa4-42ec-b433-4537a61b5d34" returned: 0 in 0.305s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-7c4a2131-1aa4-42ec-b433-4537a61b5d34" released by "_delete_snapshot" :: held 1.949s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-069aa268-0da6-4334-b59a-759abd035772" released by "delete_snapshot" :: held 1.974s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Created reservations ['e07cf8ee-a9ee-4841-9088-57589fe33383', 'ffc447f8-a8e5-4052-a550-6a33d655664f', '73bb6c52-68c2-451e-b237-b5378e7941e0', '131efe85-9e9e-4f43-8ec4-7dfa9f8f4e98'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:34 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Delete snapshot completed successfully. Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f9e1631b-bd4b-46a6-bbc3-abde8c010398 tempest-VolumeDependencyTests-36913452 None] Lock "cinder-7c4a2131-1aa4-42ec-b433-4537a61b5d34-delete_snapshot" released by "delete_snapshot" :: held 2.138s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:34 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 1G" returned: 0 in 0.515s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:34 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 Nov 01 09:14:34 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:35 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448" returned: 0 in 0.289s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:35 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 is being set with open permissions: ugo+rw Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:35 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 Nov 01 09:14:35 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:35 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448" returned: 0 in 0.249s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:35 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.info Nov 01 09:14:35 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:35 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.info" returned: 0 in 0.252s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:35 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.info is being set with open permissions: ugo+rw Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:35 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.info Nov 01 09:14:35 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-069aa268-0da6-4334-b59a-759abd035772-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Lock "cinder-069aa268-0da6-4334-b59a-759abd035772-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-quobyte-069aa268-0da6-4334-b59a-759abd035772" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-069aa268-0da6-4334-b59a-759abd035772" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3ceeb-18bd-4a82-82d5-d48f33fb7ffd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:35 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.info" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.116s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.569s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Creating offline snapshot e5051ad4-619a-4b71-aba3-afdc98e8a92c of volume d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:14:35 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 Nov 01 09:14:35 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4eeaec5e-f871-4fc1-b69e-0f3b3b6601b0 tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5efe1f-b849-4066-adc6-428da3c293ce]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:36 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 Nov 01 09:14:36 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:36 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:36 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772 Nov 01 09:14:36 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:36 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:36 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c 1G Nov 01 09:14:36 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:36 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-069aa268-0da6-4334-b59a-759abd035772" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-069aa268-0da6-4334-b59a-759abd035772" released by "delete_volume" :: held 0.752s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Created reservations ['7f4a85b4-b4e3-4ced-8ff1-c6462fc5d9e8', 'edf7a18e-3f09-4175-b8dd-b314093af896', '16fa436c-d298-4a1e-b3ab-06ced4b1bbda', 'b8d1236a-ec6b-4de7-a48b-231b11ee8bac'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:36 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:36 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-d937f48a-e61c-46d9-85d3-1e6c9e63b350-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:36 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c 1G" returned: 0 in 0.547s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d385023a-e851-4c39-b325-ce4dc8d26607 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-23fb716c-30b6-411a-a64f-89f22b427448-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Lock "cinder-d937f48a-e61c-46d9-85d3-1e6c9e63b350-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:36 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-23fb716c-30b6-411a-a64f-89f22b427448-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:36 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d385023a-e851-4c39-b325-ce4dc8d26607 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c Nov 01 09:14:36 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:36 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-23fb716c-30b6-411a-a64f-89f22b427448" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Deleted volume successfully. Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-23fb716c-30b6-411a-a64f-89f22b427448" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot 23fb716c-30b6-411a-a64f-89f22b427448 of volume 918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Acquiring lock "cinder-quobyte-d937f48a-e61c-46d9-85d3-1e6c9e63b350" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-cd634b6a-03ad-4e74-a64d-fb61ff6bf39a tempest-VolumeDependencyTests-36913452 None] Lock "cinder-069aa268-0da6-4334-b59a-759abd035772-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bbb3b6-b8a0-4b15-8c07-8e3889c1262c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-d937f48a-e61c-46d9-85d3-1e6c9e63b350" acquired by "delete_volume" :: waited 0.040s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b20f63-e694-4e67-9611-ca805cc66c41]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:37 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 Nov 01 09:14:37 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:37 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 Nov 01 09:14:37 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:37 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d385023a-e851-4c39-b325-ce4dc8d26607 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c" returned: 0 in 0.425s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:37 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c is being set with open permissions: ugo+rw Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:37 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c Nov 01 09:14:37 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:37 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448" returned: 0 in 0.494s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:37 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:37 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c" returned: 0 in 0.311s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350" returned: 0 in 0.468s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f902d88a-cf4f-44bd-8f53-e412ed15f67f]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:37 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350 Nov 01 09:14:37 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:37 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.info Nov 01 09:14:37 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:37 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 Nov 01 09:14:37 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:37 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d937f48a-e61c-46d9-85d3-1e6c9e63b350" returned: 0 in 0.333s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Lock "cinder-quobyte-d937f48a-e61c-46d9-85d3-1e6c9e63b350" released by "delete_volume" :: held 0.893s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:38 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.info" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Created reservations ['90e0f167-a328-48ec-822b-8dbd72a6d40e', '643d9fea-7d25-43ed-b23b-1b32139a89ef', '45a47814-1bc3-4325-9d2f-dfb1a1015950', 'e74307b7-9be8-4435-8920-7862b3cb2b07'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:38 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.info is being set with open permissions: ugo+rw Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:38 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" returned: 0 in 0.478s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:38 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.info Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:38 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:38 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 Nov 01 09:14:38 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:38 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:38 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:38 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.info" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.564s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-073797ad-05b1-40ce-8362-4cfbcf9e88a2 tempest-SnapshotDependencyTests-502225619 None] Create snapshot completed successfully Nov 01 09:14:38 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.328s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Deleted volume successfully. Nov 01 09:14:38 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448" returned: 0 in 0.450s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-1ac45163-438e-4767-a737-a93da805c84e tempest-VolumeDependencyTests-36913452 None] Lock "cinder-d937f48a-e61c-46d9-85d3-1e6c9e63b350-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:38 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448 Nov 01 09:14:38 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:38 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3.23fb716c-30b6-411a-a64f-89f22b427448" returned: 0 in 0.269s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-23fb716c-30b6-411a-a64f-89f22b427448" released by "_delete_snapshot" :: held 1.848s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" released by "delete_snapshot" :: held 1.889s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:38 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Created reservations ['42dbc4fc-3ce3-4886-8209-fccd053ca4f8', 'a47bca2d-fa2b-4eeb-9633-f22ffb29e446', 'b2658650-26bc-4a2e-83d8-ab90c25dd575', 'c8bd429c-85f2-4c6d-b406-a9dc2bcaaa59'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:39 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2a5ea9d3-ef42-4cfe-93a2-68d017475457 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-23fb716c-30b6-411a-a64f-89f22b427448-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[785b2dc4-0052-4ab1-90e1-6890e4d741fd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:39 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 Nov 01 09:14:39 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:39 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" returned: 0 in 0.417s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:39 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3 Nov 01 09:14:39 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:39 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:39 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" returned: 0 in 0.305s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3" released by "delete_volume" :: held 0.804s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Created reservations ['91a36c72-150e-4876-a6a3-71401c5342e1', '4c685a68-d99e-45fe-8a37-9fdc3722d90f', '49c55296-b774-445d-8fed-f73e067974ce', 'b94b6d74-d48a-4a77-83eb-60ad264dc1d7'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:40 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:40 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Flow 'volume_create_manager' (eca612cc-b084-4c8b-8905-ef778e074345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c047f908-b601-4db2-972b-4d672b2d366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c047f908-b601-4db2-972b-4d672b2d366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10abf6c-9bab-44b3-9418-3fcdda866386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f1ded2cced40c5b0b574e5f3413409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e5051ad4-619a-4b71-aba3-afdc98e8a92c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:40Z,use_quota=True,user_id='1669bfe844604a298d8b3491ca5d7a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada8591a-8d94-4270-9835-3a92aeabed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada8591a-8d94-4270-9835-3a92aeabed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d09d64-b5bd-4156-a017-a59528879b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d09d64-b5bd-4156-a017-a59528879b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a10abf6c-9bab-44b3-9418-3fcdda866386', 'volume_name': 'volume-a10abf6c-9bab-44b3-9418-3fcdda866386', 'volume_size': 1, 'snapshot_id': 'e5051ad4-619a-4b71-aba3-afdc98e8a92c'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4ffba6-f3c4-4ca0-83a0-db9ed4d541ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4ffba6-f3c4-4ca0-83a0-db9ed4d541ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248e3f7f-9797-4723-a98f-67027fab39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:40 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Volume a10abf6c-9bab-44b3-9418-3fcdda866386: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a10abf6c-9bab-44b3-9418-3fcdda866386', 'volume_size': 1, 'snapshot_id': 'e5051ad4-619a-4b71-aba3-afdc98e8a92c'} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-quobyte-e5051ad4-619a-4b71-aba3-afdc98e8a92c-a10abf6c-9bab-44b3-9418-3fcdda866386" by "_create_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-e5051ad4-619a-4b71-aba3-afdc98e8a92c-a10abf6c-9bab-44b3-9418-3fcdda866386" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Creating volume a10abf6c-9bab-44b3-9418-3fcdda866386 from snapshot e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-quobyte-a10abf6c-9bab-44b3-9418-3fcdda866386" by "_copy_volume_from_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-a10abf6c-9bab-44b3-9418-3fcdda866386" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] snapshot: e5051ad4-619a-4b71-aba3-afdc98e8a92c, volume: a10abf6c-9bab-44b3-9418-3fcdda866386, {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c9c557-1672-401b-a537-4b01c63185a7]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:40 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.336s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:40 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:14:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-5380d51f-ca45-48e0-aaaf-86ef81d9cccf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-918f96c6-d6dc-4a52-be3b-e3d5ba561dc3-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:40 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c Nov 01 09:14:40 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (aebc6878-abde-4165-857e-c6139754a0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda1739a-9a2d-4615-a8f5-5a1891662100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda1739a-9a2d-4615-a8f5-5a1891662100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966943045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3165e4c4-8e39-483d-8257-9d75169ab2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:41Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3927e1e1-392a-43da-a767-b6e040752ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3927e1e1-392a-43da-a767-b6e040752ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:41 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2c53a0-b10c-4239-87b8-180d3a4c1781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2c53a0-b10c-4239-87b8-180d3a4c1781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3165e4c4-8e39-483d-8257-9d75169ab2c9', 'volume_name': 'volume-3165e4c4-8e39-483d-8257-9d75169ab2c9', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e9142c-3c2f-43c4-babd-120546a3c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e9142c-3c2f-43c4-babd-120546a3c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601d0013-6e4c-4122-b020-0b28733c402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:41 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Volume 3165e4c4-8e39-483d-8257-9d75169ab2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3165e4c4-8e39-483d-8257-9d75169ab2c9', 'volume_size': 1} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c" returned: 0 in 0.591s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d385023a-e851-4c39-b325-ce4dc8d26607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca5c9f9-8a91-4ec0-be94-acf8292c2117]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:41 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 Nov 01 09:14:41 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:41 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607" returned: 0 in 0.435s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Creating direct copy from snapshot {{(pid=86770) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG cinder.utils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Path /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 not found in is_blk_device check {{(pid=86770) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:14:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:41 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 Nov 01 09:14:41 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:48 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386" returned: 0 in 7.269s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:48 devstack cinder-volume[86770]: DEBUG cinder.image.image_utils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Image conversion details: src /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 {{(pid=86770) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:14:48 devstack cinder-volume[86770]: INFO cinder.image.image_utils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Converted 1024.00 MB image at 140.85 MB/s Nov 01 09:14:48 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 is being set with open permissions: ugo+rw Nov 01 09:14:48 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:48 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 Nov 01 09:14:48 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:49 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386" returned: 0 in 0.252s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-a10abf6c-9bab-44b3-9418-3fcdda866386" released by "_copy_volume_from_snapshot" :: held 8.681s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-e5051ad4-619a-4b71-aba3-afdc98e8a92c-a10abf6c-9bab-44b3-9418-3fcdda866386" released by "_create_volume_from_snapshot" :: held 8.758s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.782s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.049s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-966943045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3165e4c4-8e39-483d-8257-9d75169ab2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:41Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Creating volume 3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:49 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:49 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 1073741824 Nov 01 09:14:49 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248e3f7f-9797-4723-a98f-67027fab39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10abf6c-9bab-44b3-9418-3fcdda866386', 'volume_size': 1, 'snapshot_id': 'e5051ad4-619a-4b71-aba3-afdc98e8a92c'}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3be0f19-086c-42c5-9db0-041e5701906b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Volume volume-a10abf6c-9bab-44b3-9418-3fcdda866386 (a10abf6c-9bab-44b3-9418-3fcdda866386): created successfully Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3be0f19-086c-42c5-9db0-041e5701906b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Flow 'volume_create_manager' (eca612cc-b084-4c8b-8905-ef778e074345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c1ee06c0-6c87-4aca-bdfa-cd7accb9320c tempest-SnapshotDependencyTests-502225619 None] Created volume successfully. Nov 01 09:14:49 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 1073741824" returned: 0 in 0.426s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:49 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 Nov 01 09:14:49 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:49 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601d0013-6e4c-4122-b020-0b28733c402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3165e4c4-8e39-483d-8257-9d75169ab2c9', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731ea65b-6179-4fde-9e39-6633d41e99c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:49 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Volume volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 (3165e4c4-8e39-483d-8257-9d75169ab2c9): created successfully Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731ea65b-6179-4fde-9e39-6633d41e99c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:49 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (aebc6878-abde-4165-857e-c6139754a0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:49 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-faab4f0b-c4c1-4df4-afd4-a7f1623dd8e4 tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-e5051ad4-619a-4b71-aba3-afdc98e8a92c-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-e5051ad4-619a-4b71-aba3-afdc98e8a92c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-quobyte-d385023a-e851-4c39-b325-ce4dc8d26607" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-d385023a-e851-4c39-b325-ce4dc8d26607" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-quobyte-e5051ad4-619a-4b71-aba3-afdc98e8a92c" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-e5051ad4-619a-4b71-aba3-afdc98e8a92c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Deleting offline snapshot e5051ad4-619a-4b71-aba3-afdc98e8a92c of volume d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] snapshot_file for this snap is: volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e98e8-2607-46ac-afe4-8913ab7acfe8]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:50 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c Nov 01 09:14:50 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:50 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c" returned: 0 in 0.362s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d385023a-e851-4c39-b325-ce4dc8d26607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a87c4-52b3-4d18-8e9b-b79cca560ac0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:50 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 Nov 01 09:14:50 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:50 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot c4dc2838-38c5-478c-83e2-54dd6efadbe4 of volume 3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5ebf7-d02d-4d9f-8ddb-34e3c1e3ee18]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:51 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607" returned: 0 in 0.581s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:51 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 Nov 01 09:14:51 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:51 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c Nov 01 09:14:51 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:51 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9" returned: 0 in 0.393s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:51 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 1G Nov 01 09:14:51 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:51 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c" returned: 0 in 0.364s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:51 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c Nov 01 09:14:51 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:51 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607.e5051ad4-619a-4b71-aba3-afdc98e8a92c" returned: 0 in 0.262s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-e5051ad4-619a-4b71-aba3-afdc98e8a92c" released by "_delete_snapshot" :: held 1.695s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-d385023a-e851-4c39-b325-ce4dc8d26607" released by "delete_snapshot" :: held 1.720s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Created reservations ['a40f94bf-540c-4800-bf55-26429d38da4a', '9a5fe8ff-1177-4469-bcec-fd2f144588d6', '16484b1b-5a0a-4b17-b33d-ae327ca9a144', '70d37575-96a3-478d-ae76-5cd467cfb435'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:51 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 1G" returned: 0 in 0.467s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:51 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 Nov 01 09:14:51 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:51 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Delete snapshot completed successfully. Nov 01 09:14:51 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-618c5899-c892-4c95-8ce6-a5bdd9974f9d tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-e5051ad4-619a-4b71-aba3-afdc98e8a92c-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-d385023a-e851-4c39-b325-ce4dc8d26607-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:52 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:52 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 is being set with open permissions: ugo+rw Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-d385023a-e851-4c39-b325-ce4dc8d26607-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:52 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 Nov 01 09:14:52 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-quobyte-d385023a-e851-4c39-b325-ce4dc8d26607" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-d385023a-e851-4c39-b325-ce4dc8d26607" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[763acb0a-cdf2-46e8-8c4e-d3c774dfac70]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:52 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 Nov 01 09:14:52 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:52 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4" returned: 0 in 0.300s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:52 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.info Nov 01 09:14:52 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:52 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607" returned: 0 in 0.415s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:52 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607 Nov 01 09:14:52 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:52 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.info" returned: 0 in 0.280s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:52 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.info is being set with open permissions: ugo+rw Nov 01 09:14:52 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:52 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.info Nov 01 09:14:52 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:53 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d385023a-e851-4c39-b325-ce4dc8d26607" returned: 0 in 0.282s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-d385023a-e851-4c39-b325-ce4dc8d26607" released by "delete_volume" :: held 0.765s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:53 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.info" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f48f6114-9f0d-4b56-b47f-848bef9922de tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Created reservations ['28181fde-cc65-4e9b-9e4e-0e7977614d8f', 'cc7d631a-c16e-4b51-9d7b-5676c0f207b5', 'c859aa12-396d-4a8a-83fe-46aee75ddc54', 'a39e2665-e1de-4a96-ab08-6ad9fb599347'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:53 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:53 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-a10abf6c-9bab-44b3-9418-3fcdda866386-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-a10abf6c-9bab-44b3-9418-3fcdda866386-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "cinder-quobyte-a10abf6c-9bab-44b3-9418-3fcdda866386" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-a10abf6c-9bab-44b3-9418-3fcdda866386" acquired by "delete_volume" :: waited 0.019s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ae05ce-c0b6-41fa-823c-9f6c21af13fd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:53 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.307s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:53 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Deleted volume successfully. Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-ea3294e7-263c-4c8e-bcf0-08f7d44dff76 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-d385023a-e851-4c39-b325-ce4dc8d26607-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:53 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 Nov 01 09:14:53 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:53 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386" returned: 0 in 0.409s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:53 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:53 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386 Nov 01 09:14:53 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-c4dc2838-38c5-478c-83e2-54dd6efadbe4-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-c4dc2838-38c5-478c-83e2-54dd6efadbe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-3165e4c4-8e39-483d-8257-9d75169ab2c9" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-3165e4c4-8e39-483d-8257-9d75169ab2c9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-c4dc2838-38c5-478c-83e2-54dd6efadbe4" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c4dc2838-38c5-478c-83e2-54dd6efadbe4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot c4dc2838-38c5-478c-83e2-54dd6efadbe4 of volume 3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:14:54 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-a10abf6c-9bab-44b3-9418-3fcdda866386" returned: 0 in 0.313s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e2533c-3aa2-4656-9359-69d51c16007e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-quobyte-a10abf6c-9bab-44b3-9418-3fcdda866386" released by "delete_volume" :: held 0.781s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Created reservations ['c85db6c6-afec-41c1-9aa9-14ab1fe4b93c', '041e5b45-c5bf-4991-a40f-bcdab7c49405', 'd34b6686-40ed-4ef9-8cde-a5429afee9eb', '580b67a9-3707-4732-ae4b-7d8bb5853126'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:54 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 Nov 01 09:14:54 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:54 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:54 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:54 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.281s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:54 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Deleted volume successfully. Nov 01 09:14:54 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4" returned: 0 in 0.458s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3165e4c4-8e39-483d-8257-9d75169ab2c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-95b547e7-fe7a-4cb0-9b5b-8c2bbf20aef9 tempest-SnapshotDependencyTests-502225619 None] Lock "cinder-a10abf6c-9bab-44b3-9418-3fcdda866386-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b81fb6e-c1c8-4680-8085-b54c222e4f49]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:54 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:54 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 Nov 01 09:14:54 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (63c54dc2-9e2f-44fb-8aaf-02fb4a0cdd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090736e3-1b11-42a9-abef-a61441f1779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090736e3-1b11-42a9-abef-a61441f1779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496429991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bd0452-416c-46c7-82f4-7de0ce9c6db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:55Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92ffa34-07a2-4d86-8dcf-54b2dc8e575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:55 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92ffa34-07a2-4d86-8dcf-54b2dc8e575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe89d1b-2c84-4f01-a48b-09d16deb8910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe89d1b-2c84-4f01-a48b-09d16deb8910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bd0452-416c-46c7-82f4-7de0ce9c6db0', 'volume_name': 'volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76d2fee-99fd-4d37-a39a-2c6925a940b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76d2fee-99fd-4d37-a39a-2c6925a940b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d603417b-2499-4fa7-9a60-f44af7df8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:55 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Volume e0bd0452-416c-46c7-82f4-7de0ce9c6db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0', 'volume_size': 1} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496429991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bd0452-416c-46c7-82f4-7de0ce9c6db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:55Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Creating volume e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:55 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9" returned: 0 in 0.481s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:55 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 1073741824 Nov 01 09:14:55 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:55 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 Nov 01 09:14:55 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:55 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4" returned: 0 in 0.397s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:55 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4 Nov 01 09:14:55 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:55 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 1073741824" returned: 0 in 0.486s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:55 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 Nov 01 09:14:55 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:55 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9.c4dc2838-38c5-478c-83e2-54dd6efadbe4" returned: 0 in 0.278s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-c4dc2838-38c5-478c-83e2-54dd6efadbe4" released by "_delete_snapshot" :: held 1.750s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:55 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-3165e4c4-8e39-483d-8257-9d75169ab2c9" released by "delete_snapshot" :: held 1.772s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:56 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d603417b-2499-4fa7-9a60-f44af7df8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeb6ba0-f8d7-4b1f-afd1-ade0f5375fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Created reservations ['6eea7816-2824-4489-9b36-779853876f1d', '2559f028-867a-41df-a2b9-d9c48828ae3f', '8c54c7f5-2c89-43f4-bbc4-c8f2607d0414', 'e8f61f48-73c8-4c16-8760-5886ef4edee2'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:56 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Volume volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 (e0bd0452-416c-46c7-82f4-7de0ce9c6db0): created successfully Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aeb6ba0-f8d7-4b1f-afd1-ade0f5375fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (63c54dc2-9e2f-44fb-8aaf-02fb4a0cdd18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-50857c34-70d3-4cc6-9003-0372c9d3998f tempest-ProjectReaderTests-656728974 None] Created volume successfully. Nov 01 09:14:56 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f81ddb78-8a39-4a08-9366-0faff9fcf008 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-c4dc2838-38c5-478c-83e2-54dd6efadbe4-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-3165e4c4-8e39-483d-8257-9d75169ab2c9-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-3165e4c4-8e39-483d-8257-9d75169ab2c9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-3165e4c4-8e39-483d-8257-9d75169ab2c9" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-3165e4c4-8e39-483d-8257-9d75169ab2c9" acquired by "delete_volume" :: waited 0.020s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e721c-3947-46dd-850c-0978dad5f454]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:56 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 Nov 01 09:14:56 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:56 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9" returned: 0 in 0.387s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:56 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9 Nov 01 09:14:56 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:57 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-3165e4c4-8e39-483d-8257-9d75169ab2c9" returned: 0 in 0.251s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-3165e4c4-8e39-483d-8257-9d75169ab2c9" released by "delete_volume" :: held 0.713s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Created reservations ['9b9a0fdb-4cda-4e4f-9087-dddefc10f24e', 'bf91e1d0-4692-446f-acbd-bc428a863813', 'ac8f8ab6-bb47-458a-8e44-c91de7df70b8', '130e205a-2cf7-4e68-9668-290b8d17d90a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:57 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:14:57 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Creating offline snapshot 1a048724-2ada-4083-b101-0d862203391e of volume e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9690585-e9b2-402b-a4a9-665a4615c563]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:57 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:14:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-47bc4c61-07f8-4737-a7ed-04a0865e78c4 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-3165e4c4-8e39-483d-8257-9d75169ab2c9-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:14:57 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 Nov 01 09:14:57 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:57 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" returned: 0 in 0.402s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:57 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e 1G Nov 01 09:14:57 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (5f781812-b472-42f2-8037-4eedcc0aa73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a0668a-6c0a-452d-b126-361ad9784fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a0668a-6c0a-452d-b126-361ad9784fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443519637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:58Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63303f2a-abef-43e4-beb0-227583b9f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63303f2a-abef-43e4-beb0-227583b9f30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665de49e-b725-4052-b7e4-406ab393f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665de49e-b725-4052-b7e4-406ab393f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d', 'volume_name': 'volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4442435-65f5-4d02-935f-2ebceeb46696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4442435-65f5-4d02-935f-2ebceeb46696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c666236-de5d-4978-a863-a9c8447337fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:14:58 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Volume 265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d', 'volume_size': 1} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:58 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e 1G" returned: 0 in 0.483s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:58 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e Nov 01 09:14:58 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:58 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e" returned: 0 in 0.324s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:58 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e is being set with open permissions: ugo+rw Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:58 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e Nov 01 09:14:58 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:58 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e" returned: 0 in 0.254s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:59 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.info Nov 01 09:14:59 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:59 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.info" returned: 0 in 0.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:59 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.info is being set with open permissions: ugo+rw Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:59 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.info Nov 01 09:14:59 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:59 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.info" returned: 0 in 0.239s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.433s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443519637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:14:58Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Creating volume 265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:14:59 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:14:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:14:59 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d 1073741824 Nov 01 09:14:59 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:14:59 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-053448e1-9275-4895-8723-7351a5c01481 tempest-ProjectReaderTests-656728974 None] Create snapshot completed successfully Nov 01 09:15:00 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d 1073741824" returned: 0 in 0.467s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:00 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d Nov 01 09:15:00 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:00 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" returned: 0 in 0.254s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c666236-de5d-4978-a863-a9c8447337fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27a246a-e07b-41f8-8b5e-728ed0ffc3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Volume volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d (265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d): created successfully Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27a246a-e07b-41f8-8b5e-728ed0ffc3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (5f781812-b472-42f2-8037-4eedcc0aa73a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-345608cc-5838-4371-b082-27ff210ee89b tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-1a048724-2ada-4083-b101-0d862203391e-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Lock "cinder-1a048724-2ada-4083-b101-0d862203391e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-1a048724-2ada-4083-b101-0d862203391e" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-1a048724-2ada-4083-b101-0d862203391e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Deleting offline snapshot 1a048724-2ada-4083-b101-0d862203391e of volume e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] snapshot_file for this snap is: volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bbf89f-0535-4983-a8d0-995c796305e1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:00 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e Nov 01 09:15:00 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:01 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e" returned: 0 in 0.405s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9eb10b-830f-43bc-89b0-6352910c3afe]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot 0e37158e-7872-45e0-95ee-bc1d81860f89 of volume 265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a13718-07a8-4c93-af4c-babeb1959897]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:01 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 Nov 01 09:15:01 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:01 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d Nov 01 09:15:01 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:01 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" returned: 0 in 0.412s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:01 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e Nov 01 09:15:01 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:01 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" returned: 0 in 0.450s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:01 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 1G Nov 01 09:15:01 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:02 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e" returned: 0 in 0.340s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:02 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e Nov 01 09:15:02 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:02 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 1G" returned: 0 in 0.433s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:02 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 Nov 01 09:15:02 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:02 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0.1a048724-2ada-4083-b101-0d862203391e" returned: 0 in 0.270s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-1a048724-2ada-4083-b101-0d862203391e" released by "_delete_snapshot" :: held 1.566s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" released by "delete_snapshot" :: held 1.591s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Created reservations ['aec5fe06-f3d0-4661-8b2b-9189a0eb5e0a', '56ba4bc9-0e0e-4b21-a598-fd846def1825', '54f65b01-5fce-4877-a041-78dbdc3ad73f', '4bc20ca1-db3e-494f-b013-b1be030c8ea6'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Delete snapshot completed successfully. Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-19f0fab3-c0a6-4cc5-9be8-6ce53ea28559 tempest-ProjectReaderTests-656728974 None] Lock "cinder-1a048724-2ada-4083-b101-0d862203391e-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:02 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89" returned: 0 in 0.384s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:02 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 is being set with open permissions: ugo+rw Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:02 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 Nov 01 09:15:02 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-e0bd0452-416c-46c7-82f4-7de0ce9c6db0-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:02 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89" returned: 0 in 0.283s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Lock "cinder-e0bd0452-416c-46c7-82f4-7de0ce9c6db0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:03 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.info Nov 01 09:15:03 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7fe24-fa2e-4e75-9cfa-f466031d5cf5]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:03 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 Nov 01 09:15:03 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:03 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.info" returned: 0 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:03 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.info is being set with open permissions: ugo+rw Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:03 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.info Nov 01 09:15:03 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:03 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" returned: 0 in 0.526s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:03 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0 Nov 01 09:15:03 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:03 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.info" returned: 0 in 0.406s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.438s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:03 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-cd3f7e2a-e70f-433d-a5ff-7b4000c067f0 tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:15:04 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" returned: 0 in 0.536s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-e0bd0452-416c-46c7-82f4-7de0ce9c6db0" released by "delete_volume" :: held 1.143s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Created reservations ['bc2f81d5-1e15-45ac-92c4-118901193aec', '35d8a0b4-ba2b-4b4d-a199-da066423d233', '96b2acef-42d6-4282-9529-1e6918236a20', '2b2fae02-5396-4cbc-805b-d36ee3953925'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:04 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:04 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-0e37158e-7872-45e0-95ee-bc1d81860f89-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-0e37158e-7872-45e0-95ee-bc1d81860f89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-0e37158e-7872-45e0-95ee-bc1d81860f89" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:04 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.331s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-0e37158e-7872-45e0-95ee-bc1d81860f89" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot 0e37158e-7872-45e0-95ee-bc1d81860f89 of volume 265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:04 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Deleted volume successfully. Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51b3e20-a624-480a-ac0e-6d062f8eba6d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-de9ac09c-df42-4499-9400-ff5956082e12 tempest-ProjectReaderTests-656728974 None] Lock "cinder-e0bd0452-416c-46c7-82f4-7de0ce9c6db0-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:04 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 Nov 01 09:15:04 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:05 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89" returned: 0 in 0.408s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[99816f25-3b6b-48cd-bd72-cb451dc56014]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:05 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d Nov 01 09:15:05 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:05 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" returned: 0 in 0.444s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:05 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 Nov 01 09:15:05 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (648bf4f6-cd71-4422-8726-695496e53403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc4d486-176c-48bb-b68b-e4dec32feb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc4d486-176c-48bb-b68b-e4dec32feb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387717244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1255738-f7ed-496d-8ed2-eed5d2bc5e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:06Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844a1dcf-7e9f-4890-814e-828778365729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844a1dcf-7e9f-4890-814e-828778365729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbc2cbb-d052-4e1f-b736-fda510bb5c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbc2cbb-d052-4e1f-b736-fda510bb5c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1255738-f7ed-496d-8ed2-eed5d2bc5e36', 'volume_name': 'volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a2ad41-2883-478b-96de-21cd86e6ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a2ad41-2883-478b-96de-21cd86e6ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc963ce-d743-4441-9be5-ded9342508fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Volume b1255738-f7ed-496d-8ed2-eed5d2bc5e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36', 'volume_size': 1} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387717244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1255738-f7ed-496d-8ed2-eed5d2bc5e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:06Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Creating volume b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:05 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:05 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 1073741824 Nov 01 09:15:05 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:06 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89" returned: 0 in 0.420s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:06 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89 Nov 01 09:15:06 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:06 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d.0e37158e-7872-45e0-95ee-bc1d81860f89" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:06 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 1073741824" returned: 0 in 0.447s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-0e37158e-7872-45e0-95ee-bc1d81860f89" released by "_delete_snapshot" :: held 1.669s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" released by "delete_snapshot" :: held 1.702s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:06 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 Nov 01 09:15:06 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Created reservations ['5976fa0d-1439-4aef-a96a-7a0ae7e15416', '617b48ff-1991-41fd-8c78-a4a13fde5feb', 'f69609e9-0219-4b64-baeb-445fc1c616f7', '0c7e8d02-59ca-4469-bfd9-a851122ada48'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-be2e813f-ff91-4e1a-839e-808403febc1f tempest-ProjectMemberTests-1799352219 None] Lock "cinder-0e37158e-7872-45e0-95ee-bc1d81860f89-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:06 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc963ce-d743-4441-9be5-ded9342508fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e206ec-311e-4f80-b7d6-7f4f31dbe38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:06 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Volume volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 (b1255738-f7ed-496d-8ed2-eed5d2bc5e36): created successfully Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e206ec-311e-4f80-b7d6-7f4f31dbe38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (648bf4f6-cd71-4422-8726-695496e53403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-23ca74d4-b0e7-4ab4-b49c-e72392a5930b tempest-ProjectReaderTests-656728974 None] Created volume successfully. Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b63f5-02fe-4c61-b8b4-7e5a5129b2c5]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:06 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d Nov 01 09:15:06 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:07 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" returned: 0 in 0.360s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:07 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d Nov 01 09:15:07 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:07 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" returned: 0 in 0.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d" released by "delete_volume" :: held 0.693s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Created reservations ['74dbd223-210b-45a8-887c-918edc8420dc', 'c58ab5cb-cd05-4d5d-a89b-8d311aad77ca', '8c27c44a-7320-4153-8a9a-de782c36fdde', 'e77dcb07-6d2f-4567-a15c-b84160b945b9'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:07 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:07 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:07 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.302s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:07 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:07 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b02345b9-ed0b-4a41-8af7-d10a5fe2d0d9 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-265cb39f-a1ef-41f1-a6a0-4b5cb7cfbb7d-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Creating offline snapshot aadf54e5-d120-47d7-af13-4d91ded208fa of volume b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c692885d-69ff-4a54-9552-45f78f1969ee]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:08 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 Nov 01 09:15:08 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:08 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" returned: 0 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:08 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa 1G Nov 01 09:15:08 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (07d716fd-3457-4f7f-9c46-14e3a821952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d29b5e-b3c5-4136-8ed1-19036633b449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d29b5e-b3c5-4136-8ed1-19036633b449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154784830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32416aa-41f3-4735-a25b-59152358656f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:08Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740398ee-95a7-4c29-adaf-b29d3b8f5213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740398ee-95a7-4c29-adaf-b29d3b8f5213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6293308b-524f-4b2a-8d89-49b0a2579635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6293308b-524f-4b2a-8d89-49b0a2579635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32416aa-41f3-4735-a25b-59152358656f', 'volume_name': 'volume-b32416aa-41f3-4735-a25b-59152358656f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41910eee-5c66-447b-bcd5-92df1de8e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41910eee-5c66-447b-bcd5-92df1de8e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fd339e-f0e1-444e-b0c9-a63ac72d5f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:08 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Volume b32416aa-41f3-4735-a25b-59152358656f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32416aa-41f3-4735-a25b-59152358656f', 'volume_size': 1} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:08 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa 1G" returned: 0 in 0.401s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:08 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:08 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa Nov 01 09:15:08 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:09 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa" returned: 0 in 0.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:09 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa is being set with open permissions: ugo+rw Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:09 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa Nov 01 09:15:09 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:09 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:09 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.info Nov 01 09:15:09 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:09 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.info" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:09 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.info is being set with open permissions: ugo+rw Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:09 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.info Nov 01 09:15:09 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:09 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.info" returned: 0 in 0.238s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154784830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32416aa-41f3-4735-a25b-59152358656f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:08Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Creating volume b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:09 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:09 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:09 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f 1073741824 Nov 01 09:15:09 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:09 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9364c54a-1ecf-4b6c-b35b-06f0f653b91a tempest-ProjectReaderTests-656728974 None] Create snapshot completed successfully Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-aadf54e5-d120-47d7-af13-4d91ded208fa-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Lock "cinder-aadf54e5-d120-47d7-af13-4d91ded208fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-aadf54e5-d120-47d7-af13-4d91ded208fa" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-aadf54e5-d120-47d7-af13-4d91ded208fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Deleting offline snapshot aadf54e5-d120-47d7-af13-4d91ded208fa of volume b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] snapshot_file for this snap is: volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f46138-8d1d-4261-a52d-62eea8ebd9fb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:10 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f 1073741824" returned: 0 in 0.462s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:10 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa Nov 01 09:15:10 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:10 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f Nov 01 09:15:10 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:10 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f" returned: 0 in 0.239s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:10 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa" returned: 0 in 0.401s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fd339e-f0e1-444e-b0c9-a63ac72d5f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32416aa-41f3-4735-a25b-59152358656f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eff0974-18da-49f4-87d0-1c323a7d81e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0050ff7c-af8b-4bb3-bb61-9774c6b4ac88]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:10 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Volume volume-b32416aa-41f3-4735-a25b-59152358656f (b32416aa-41f3-4735-a25b-59152358656f): created successfully Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eff0974-18da-49f4-87d0-1c323a7d81e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:10 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (07d716fd-3457-4f7f-9c46-14e3a821952f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:10 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d33c7f55-dc18-4629-a9fc-f85714fad51f tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:15:10 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 Nov 01 09:15:10 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:11 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" returned: 0 in 0.373s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:11 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa Nov 01 09:15:11 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:11 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa" returned: 0 in 0.319s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:11 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa Nov 01 09:15:11 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:11 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36.aadf54e5-d120-47d7-af13-4d91ded208fa" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-aadf54e5-d120-47d7-af13-4d91ded208fa" released by "_delete_snapshot" :: held 1.466s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" released by "delete_snapshot" :: held 1.492s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Created reservations ['c579aed3-253a-4655-9d63-204ac70f01a6', '164fd0a4-dde8-499a-bc2a-015b4a198857', 'b1b94d89-f257-41a2-aa1d-6b8d784c002b', '4c8ea063-1653-4618-b2f7-6a0f7af1b204'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot f6776a65-277a-465e-8431-0b6850f93498 of volume b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0c835d-0376-4b4a-a63e-0d5278024e10]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:11 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Delete snapshot completed successfully. Nov 01 09:15:11 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-b3e79db5-d26b-4356-ae39-340ad30b30e6 tempest-ProjectReaderTests-656728974 None] Lock "cinder-aadf54e5-d120-47d7-af13-4d91ded208fa-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:11 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f Nov 01 09:15:11 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:12 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f" returned: 0 in 0.340s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:12 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 1G Nov 01 09:15:12 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-b1255738-f7ed-496d-8ed2-eed5d2bc5e36-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Lock "cinder-b1255738-f7ed-496d-8ed2-eed5d2bc5e36-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8156b28-d815-479a-ac97-dae715f186fd]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:12 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 Nov 01 09:15:12 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:12 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 1G" returned: 0 in 0.402s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32416aa-41f3-4735-a25b-59152358656f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:12 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32416aa-41f3-4735-a25b-59152358656f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 Nov 01 09:15:12 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:12 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" returned: 0 in 0.398s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:12 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36 Nov 01 09:15:12 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:12 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32416aa-41f3-4735-a25b-59152358656f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498" returned: 0 in 0.313s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:12 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 is being set with open permissions: ugo+rw Nov 01 09:15:12 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:12 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 Nov 01 09:15:12 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:13 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" returned: 0 in 0.243s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-b1255738-f7ed-496d-8ed2-eed5d2bc5e36" released by "delete_volume" :: held 0.701s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:13 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498" returned: 0 in 0.246s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Created reservations ['6d60e5e0-17ad-4eec-9151-04cc3726ff21', '4d40af77-9bc7-4f70-bb67-d89158fd43c3', '2b0005d0-c7ec-41a6-8330-c76b09cb470c', '2c23e1f3-3062-4108-adc0-fbb138831961'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:13 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.info Nov 01 09:15:13 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:13 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:13 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:13 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.info" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:13 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.info is being set with open permissions: ugo+rw Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:13 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.info Nov 01 09:15:13 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:13 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.253s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:13 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Deleted volume successfully. Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-4863a931-4128-46da-9c89-b472614c4cc0 tempest-ProjectReaderTests-656728974 None] Lock "cinder-b1255738-f7ed-496d-8ed2-eed5d2bc5e36-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:13 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.info" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:13 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d3b2737f-a35d-40da-bae4-59982083b6ea tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-f6776a65-277a-465e-8431-0b6850f93498-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-f6776a65-277a-465e-8431-0b6850f93498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-b32416aa-41f3-4735-a25b-59152358656f" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (7d61ceff-e788-42e0-bd6d-0c3b93eebfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d69067-dd26-4b1c-af33-37cf19eed73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-b32416aa-41f3-4735-a25b-59152358656f" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-f6776a65-277a-465e-8431-0b6850f93498" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d69067-dd26-4b1c-af33-37cf19eed73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1042909355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5b76cc-ec16-44f6-b510-0b2940edf9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:14Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964fadcf-6b3b-4546-9a71-75e54b08d5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964fadcf-6b3b-4546-9a71-75e54b08d5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912983c9-f491-4a7a-896b-1ebf71da6b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912983c9-f491-4a7a-896b-1ebf71da6b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5b76cc-ec16-44f6-b510-0b2940edf9ce', 'volume_name': 'volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:13 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc3d571-61ec-410d-b72f-2f8696a29309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc3d571-61ec-410d-b72f-2f8696a29309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcde466-cd3c-418b-8cca-072ab2d86959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:14 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Volume 5a5b76cc-ec16-44f6-b510-0b2940edf9ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce', 'volume_size': 1} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1042909355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5b76cc-ec16-44f6-b510-0b2940edf9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:14Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Creating volume 5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:14 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-f6776a65-277a-465e-8431-0b6850f93498" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot f6776a65-277a-465e-8431-0b6850f93498 of volume b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:14 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce 1073741824 Nov 01 09:15:14 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50580b8-32f4-47bd-bff3-3fa644e84381]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:14 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 Nov 01 09:15:14 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:14 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498" returned: 0 in 0.380s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b32416aa-41f3-4735-a25b-59152358656f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:14 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce 1073741824" returned: 0 in 0.453s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2568929-3a5b-487f-b3d5-7bd95c98e456]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:14 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce Nov 01 09:15:14 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:14 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f Nov 01 09:15:14 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:14 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" returned: 0 in 0.233s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcde466-cd3c-418b-8cca-072ab2d86959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c93c926-0d95-4f5c-b232-273b33517e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:14 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Volume volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce (5a5b76cc-ec16-44f6-b510-0b2940edf9ce): created successfully Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c93c926-0d95-4f5c-b232-273b33517e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (7d61ceff-e788-42e0-bd6d-0c3b93eebfe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:14 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d69beb8f-afc7-4386-8b8a-0c8ab729bab8 tempest-ProjectReaderTests-656728974 None] Created volume successfully. Nov 01 09:15:14 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:14 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:14 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 Nov 01 09:15:14 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Creating offline snapshot a8df7748-dcc4-4ab9-b884-618ca99b8f57 of volume 5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10305e-a068-46ce-ae0b-e861a3daa313]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:15 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce Nov 01 09:15:15 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:15 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498" returned: 0 in 0.377s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:15 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498 Nov 01 09:15:15 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:15 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" returned: 0 in 0.369s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:15 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f.f6776a65-277a-465e-8431-0b6850f93498" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:15 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 1G Nov 01 09:15:15 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-f6776a65-277a-465e-8431-0b6850f93498" released by "_delete_snapshot" :: held 1.505s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-b32416aa-41f3-4735-a25b-59152358656f" released by "delete_snapshot" :: held 1.588s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Created reservations ['d173eaa7-fa70-4060-b5be-2903edfb9b76', 'c3b763dc-922e-4856-b18a-f8b2a0d4f4ab', 'de042875-d417-444f-ac16-b49be4e96add', 'fb852e9c-9664-477d-a57c-7db5bdc1b228'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:15 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e084f160-2d5c-488e-bc5b-d44aaf3ac7a2 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-f6776a65-277a-465e-8431-0b6850f93498-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:15 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 1G" returned: 0 in 0.419s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:15 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:15 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 Nov 01 09:15:15 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-b32416aa-41f3-4735-a25b-59152358656f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-b32416aa-41f3-4735-a25b-59152358656f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-b32416aa-41f3-4735-a25b-59152358656f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-b32416aa-41f3-4735-a25b-59152358656f" acquired by "delete_volume" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[be530a42-4af6-47a8-a23c-adcdba6f52fb]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:16 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57" returned: 0 in 0.298s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:16 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 is being set with open permissions: ugo+rw Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:16 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 Nov 01 09:15:16 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:16 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f Nov 01 09:15:16 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:16 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57" returned: 0 in 0.259s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:16 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.info Nov 01 09:15:16 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:16 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f" returned: 0 in 0.371s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:16 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f Nov 01 09:15:16 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:16 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.info" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:16 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.info is being set with open permissions: ugo+rw Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:16 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.info Nov 01 09:15:16 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:16 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-b32416aa-41f3-4735-a25b-59152358656f" returned: 0 in 0.266s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-b32416aa-41f3-4735-a25b-59152358656f" released by "delete_volume" :: held 0.710s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Created reservations ['4780e984-7ff7-45fd-b2fc-2e9797cb8bf7', 'e47095f8-a466-42e9-8cb4-9588312d8c14', '8a6e145f-c09c-46aa-a868-fb56ce956994', '9a0f807d-525e-4273-a954-abd7481e20f0'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:16 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:16 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:16 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:17 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.info" returned: 0 in 0.252s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-60de0eae-1ad9-474a-8b4f-fcbf3cf1e6b5 tempest-ProjectReaderTests-656728974 None] Create snapshot completed successfully Nov 01 09:15:17 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.258s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:17 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-a8df7748-dcc4-4ab9-b884-618ca99b8f57-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9c4e61e6-db32-4793-8fbf-ce3ec7f942cf tempest-ProjectMemberTests-1799352219 None] Lock "cinder-b32416aa-41f3-4735-a25b-59152358656f-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Lock "cinder-a8df7748-dcc4-4ab9-b884-618ca99b8f57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-a8df7748-dcc4-4ab9-b884-618ca99b8f57" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-a8df7748-dcc4-4ab9-b884-618ca99b8f57" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Deleting offline snapshot a8df7748-dcc4-4ab9-b884-618ca99b8f57 of volume 5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] snapshot_file for this snap is: volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38f86da-80b9-4718-9255-eba581e593b4]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:17 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 Nov 01 09:15:17 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:17 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (7d14996e-41eb-4433-bc3a-245bda86c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7819ab18-daf3-493a-9df4-964e70502758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57" returned: 0 in 0.414s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7819ab18-daf3-493a-9df4-964e70502758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100311363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b6f769-9e7a-4041-bef3-3981e67b66f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:18Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f5a8de-3052-4052-98e7-724a0d40e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f5a8de-3052-4052-98e7-724a0d40e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1849ae19-ef5a-40e1-9181-b9beb7d60b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1849ae19-ef5a-40e1-9181-b9beb7d60b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b6f769-9e7a-4041-bef3-3981e67b66f4', 'volume_name': 'volume-14b6f769-9e7a-4041-bef3-3981e67b66f4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5ab5fc-a569-45aa-b9ef-381f91b1b849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5ab5fc-a569-45aa-b9ef-381f91b1b849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42fc875-ec41-4d77-9741-2f9d8f1028d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:17 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Volume 14b6f769-9e7a-4041-bef3-3981e67b66f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b6f769-9e7a-4041-bef3-3981e67b66f4', 'volume_size': 1} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100311363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b6f769-9e7a-4041-bef3-3981e67b66f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:18Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Creating volume 14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:17 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[2244edf9-1dcf-4134-8f73-fb781a6c136d]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:17 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:17 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 1073741824 Nov 01 09:15:17 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:17 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce Nov 01 09:15:17 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:18 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" returned: 0 in 0.370s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:18 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 Nov 01 09:15:18 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:18 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 1073741824" returned: 0 in 0.420s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:18 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 Nov 01 09:15:18 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:18 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4" returned: 0 in 0.260s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42fc875-ec41-4d77-9741-2f9d8f1028d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b6f769-9e7a-4041-bef3-3981e67b66f4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:18 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36c10fa-5812-4240-98e4-9f70ce8bd031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57" returned: 0 in 0.357s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:18 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Volume volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 (14b6f769-9e7a-4041-bef3-3981e67b66f4): created successfully Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36c10fa-5812-4240-98e4-9f70ce8bd031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (7d14996e-41eb-4433-bc3a-245bda86c09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:18 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57 Nov 01 09:15:18 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:18 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-94afe606-bb47-4329-a317-c8ebbab3ef1a tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:15:18 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce.a8df7748-dcc4-4ab9-b884-618ca99b8f57" returned: 0 in 0.293s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-a8df7748-dcc4-4ab9-b884-618ca99b8f57" released by "_delete_snapshot" :: held 1.598s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" released by "delete_snapshot" :: held 1.626s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot daeb1e01-b192-44e8-98a4-4aad79251c1a of volume 14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d4f60-5cc3-4ff9-8ed0-2e273f036450]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:18 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Created reservations ['313ef7ab-74a6-417a-8942-1812f1c16d26', '4b10166a-0bea-4974-a555-1e0c1787eb63', '0132e02d-100d-46a6-a419-afa78dbf7969', '56ecc0a3-f781-4c17-82b8-f9c31b8d9c6f'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:19 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Delete snapshot completed successfully. Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-062890a7-36d0-47c2-9bc4-13b89983990a tempest-ProjectReaderTests-656728974 None] Lock "cinder-a8df7748-dcc4-4ab9-b884-618ca99b8f57-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:19 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 Nov 01 09:15:19 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:19 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4" returned: 0 in 0.355s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:19 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a 1G Nov 01 09:15:19 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-5a5b76cc-ec16-44f6-b510-0b2940edf9ce-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Lock "cinder-5a5b76cc-ec16-44f6-b510-0b2940edf9ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d3e23b-a9f4-4c5d-9ad5-e7d04d85ca25]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:19 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce Nov 01 09:15:19 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:19 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a 1G" returned: 0 in 0.458s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:19 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a Nov 01 09:15:19 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:19 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" returned: 0 in 0.415s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:19 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:19 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce Nov 01 09:15:19 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:20 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a" returned: 0 in 0.306s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:20 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a is being set with open permissions: ugo+rw Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:20 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a Nov 01 09:15:20 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:20 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" returned: 0 in 0.257s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-5a5b76cc-ec16-44f6-b510-0b2940edf9ce" released by "delete_volume" :: held 0.741s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Created reservations ['fd2f7822-1c33-480d-ae76-1f370018b881', '42042ec9-d076-4091-9eb6-70fd4a6db686', '236f23c9-1674-4c24-9c6f-1682f1c9663b', '2ba09436-326b-4fbc-891c-53fbd33047cc'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:20 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a" returned: 0 in 0.307s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:20 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.info Nov 01 09:15:20 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:20 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:20 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:20 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.info" returned: 0 in 0.270s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:20 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.info is being set with open permissions: ugo+rw Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:20 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.260s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:20 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.info Nov 01 09:15:20 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Deleted volume successfully. Nov 01 09:15:20 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-68271f18-cbaf-4fb0-9d4c-3913bd39c065 tempest-ProjectReaderTests-656728974 None] Lock "cinder-5a5b76cc-ec16-44f6-b510-0b2940edf9ce-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:20 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.info" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:20 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:21 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-5d882281-30fa-4732-83e9-bdb495929696 tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (002e408d-3d40-4d69-bfc3-5be321113b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3766a029-2c4f-473a-91aa-fefeff13c868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3766a029-2c4f-473a-91aa-fefeff13c868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058704555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93484f9f-227e-4890-a25b-154e771de42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:21Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ee7f6-8993-40b1-bc3e-530cd8c5d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ee7f6-8993-40b1-bc3e-530cd8c5d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbcbbd4-bfdb-4aa5-bf88-30cccdb5ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbcbbd4-bfdb-4aa5-bf88-30cccdb5ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93484f9f-227e-4890-a25b-154e771de42f', 'volume_name': 'volume-93484f9f-227e-4890-a25b-154e771de42f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6240247d-1b4b-4775-9055-0d3949114f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6240247d-1b4b-4775-9055-0d3949114f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c5fdf8-40ff-4217-ba7f-7ee3e3fd37b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:21 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Volume 93484f9f-227e-4890-a25b-154e771de42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93484f9f-227e-4890-a25b-154e771de42f', 'volume_size': 1} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058704555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93484f9f-227e-4890-a25b-154e771de42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:21Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Creating volume 93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:21 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:21 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f 1073741824 Nov 01 09:15:21 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:21 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:21 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:21 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f 1073741824" returned: 0 in 0.419s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:21 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f Nov 01 09:15:21 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:21 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:15:21 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=185,cinder:SELECT=154,cinder:INSERT=53,cinder:DELETE=17 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c5fdf8-40ff-4217-ba7f-7ee3e3fd37b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93484f9f-227e-4890-a25b-154e771de42f', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61736233-7da4-4d06-86b9-419fdc7e7a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:21 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Volume volume-93484f9f-227e-4890-a25b-154e771de42f (93484f9f-227e-4890-a25b-154e771de42f): created successfully Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61736233-7da4-4d06-86b9-419fdc7e7a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (002e408d-3d40-4d69-bfc3-5be321113b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:21 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7e2bf3bc-435c-41dc-9e98-6b0ab34c58a3 tempest-ProjectReaderTests-656728974 None] Created volume successfully. Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-daeb1e01-b192-44e8-98a4-4aad79251c1a-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-daeb1e01-b192-44e8-98a4-4aad79251c1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-14b6f769-9e7a-4041-bef3-3981e67b66f4" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-14b6f769-9e7a-4041-bef3-3981e67b66f4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-daeb1e01-b192-44e8-98a4-4aad79251c1a" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-daeb1e01-b192-44e8-98a4-4aad79251c1a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot daeb1e01-b192-44e8-98a4-4aad79251c1a of volume 14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff9c953-542e-4a55-aa16-daa3250e66c0]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=148,cinder:INSERT=52,cinder:UPDATE=204,cinder:DELETE=15 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Creating offline snapshot 607f62e2-1620-4057-a22d-c93326d7155d of volume 93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824164c-2a69-4eea-9034-140b1926805c]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:22 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a Nov 01 09:15:22 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:22 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f Nov 01 09:15:22 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:22 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a" returned: 0 in 0.398s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14b6f769-9e7a-4041-bef3-3981e67b66f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6642fa1-1c67-4f4f-89af-b8b1a5e1abfe]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:22 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f" returned: 0 in 0.400s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:22 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:22 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d 1G Nov 01 09:15:22 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:22 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 Nov 01 09:15:22 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:23 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4" returned: 0 in 0.379s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:23 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a Nov 01 09:15:23 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:23 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d 1G" returned: 0 in 0.422s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93484f9f-227e-4890-a25b-154e771de42f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:23 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93484f9f-227e-4890-a25b-154e771de42f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d Nov 01 09:15:23 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:23 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a" returned: 0 in 0.368s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:23 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a Nov 01 09:15:23 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:23 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93484f9f-227e-4890-a25b-154e771de42f -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d" returned: 0 in 0.328s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:23 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d is being set with open permissions: ugo+rw Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:23 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d Nov 01 09:15:23 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:23 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4.daeb1e01-b192-44e8-98a4-4aad79251c1a" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-daeb1e01-b192-44e8-98a4-4aad79251c1a" released by "_delete_snapshot" :: held 1.534s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-14b6f769-9e7a-4041-bef3-3981e67b66f4" released by "delete_snapshot" :: held 1.556s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:23 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d" returned: 0 in 0.267s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Created reservations ['2ad6ac77-cfe6-4c0e-a4b5-09de8f0698c7', 'c1589eb8-ad87-4c8d-a458-216703b99bfc', '46b51dff-8c34-41f7-a2eb-9ce1c151f7ac', '9c999d03-8a24-4c20-b312-9cb8eb9948b5'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:23 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.info Nov 01 09:15:23 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:23 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:15:23 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-2e62c4b1-9730-4085-970c-9345a06cc458 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-daeb1e01-b192-44e8-98a4-4aad79251c1a-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:24 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.info" returned: 0 in 0.251s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:24 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.info is being set with open permissions: ugo+rw Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:24 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.info Nov 01 09:15:24 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-14b6f769-9e7a-4041-bef3-3981e67b66f4-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:24 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.info" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-14b6f769-9e7a-4041-bef3-3981e67b66f4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:24 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-20a6f008-d049-4a81-ae66-e602fb8b42c8 tempest-ProjectReaderTests-656728974 None] Create snapshot completed successfully Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-14b6f769-9e7a-4041-bef3-3981e67b66f4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-14b6f769-9e7a-4041-bef3-3981e67b66f4" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3951be-b582-4428-8d6a-a28f3b7f7996]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:24 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 Nov 01 09:15:24 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:24 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4" returned: 0 in 0.359s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:24 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:24 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4 Nov 01 09:15:24 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:25 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-14b6f769-9e7a-4041-bef3-3981e67b66f4" returned: 0 in 0.243s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-14b6f769-9e7a-4041-bef3-3981e67b66f4" released by "delete_volume" :: held 0.661s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Created reservations ['9ea9bfa0-efec-43b2-86b2-f7e1d32f66b1', '946c2ec1-a6e8-4cc3-9384-5cec6a9aa849', '70530a5d-0d16-4a4a-aaa6-2ad83e425d38', '61027a1c-8bc9-408e-be28-6038c1fcfe16'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:25 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:25 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:25 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.250s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:25 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-bfc9dbca-edef-46f1-be11-2caa90dd4111 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-14b6f769-9e7a-4041-bef3-3981e67b66f4-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-607f62e2-1620-4057-a22d-c93326d7155d-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Lock "cinder-607f62e2-1620-4057-a22d-c93326d7155d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-93484f9f-227e-4890-a25b-154e771de42f" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-93484f9f-227e-4890-a25b-154e771de42f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-607f62e2-1620-4057-a22d-c93326d7155d" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-607f62e2-1620-4057-a22d-c93326d7155d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Deleting offline snapshot 607f62e2-1620-4057-a22d-c93326d7155d of volume 93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] snapshot_file for this snap is: volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39f3d29-4452-4d49-97c6-3a8b37db54cc]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:25 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d Nov 01 09:15:25 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (4d220d8f-aa47-4bd0-b77d-28a0abbe47bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95546a-8538-4503-aec9-3067eb35ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:25 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95546a-8538-4503-aec9-3067eb35ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819324564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ffcf1d-7720-4e33-b99f-2d74a416dbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:26Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceee78d-811a-4c0a-8814-edb749e5a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceee78d-811a-4c0a-8814-edb749e5a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7aaa89-db77-43ad-bafa-7e36e3ffadfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7aaa89-db77-43ad-bafa-7e36e3ffadfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ffcf1d-7720-4e33-b99f-2d74a416dbc4', 'volume_name': 'volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc065e8-3e87-45f0-a311-431af207f7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc065e8-3e87-45f0-a311-431af207f7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae43a6-b269-4aa4-9acb-e50a46ed50ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:25 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Volume 91ffcf1d-7720-4e33-b99f-2d74a416dbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4', 'volume_size': 1} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:25 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819324564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ffcf1d-7720-4e33-b99f-2d74a416dbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff8a3bbfd1234266a095546713f40cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:26Z,use_quota=True,user_id='06fa18e8352540268e5842941ee747a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Creating volume 91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:26 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d" returned: 0 in 0.460s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93484f9f-227e-4890-a25b-154e771de42f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:26 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 1073741824 Nov 01 09:15:26 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b249f726-4bc8-4296-bd94-25d3c219c744]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:26 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f Nov 01 09:15:26 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:26 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:26 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 1073741824" returned: 0 in 0.427s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f" returned: 0 in 0.383s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:26 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d Nov 01 09:15:26 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:26 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 Nov 01 09:15:26 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:26 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" returned: 0 in 0.261s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daae43a6-b269-4aa4-9acb-e50a46ed50ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1a7f6e-68be-4eea-91e7-edc5a27eec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:26 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d" returned: 0 in 0.341s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:26 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Volume volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 (91ffcf1d-7720-4e33-b99f-2d74a416dbc4): created successfully Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1a7f6e-68be-4eea-91e7-edc5a27eec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:26 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Flow 'volume_create_manager' (4d220d8f-aa47-4bd0-b77d-28a0abbe47bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:26 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d Nov 01 09:15:26 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:26 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-217592f2-94a9-4524-b078-af986fff1072 tempest-ProjectMemberTests-1799352219 None] Created volume successfully. Nov 01 09:15:27 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f.607f62e2-1620-4057-a22d-c93326d7155d" returned: 0 in 0.255s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-607f62e2-1620-4057-a22d-c93326d7155d" released by "_delete_snapshot" :: held 1.566s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-93484f9f-227e-4890-a25b-154e771de42f" released by "delete_snapshot" :: held 1.592s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Creating offline snapshot 1f9405f0-4bb2-4ed9-a5d5-c22498e5608b of volume 91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f17333-9ded-4300-b82a-8f6a5b3b2f84]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Created reservations ['3338ca60-e33e-43b9-825a-1e2f3b4f84a5', 'c7170fa5-28c2-49bd-aea4-e12f63606374', '4b26e076-f32c-4690-8f03-07aacc8bae66', 'e0fc59b3-256b-48f4-8ae0-70760c71fe8a'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:27 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Delete snapshot completed successfully. Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-120996d7-db0e-4472-9664-66c922dbf24a tempest-ProjectReaderTests-656728974 None] Lock "cinder-607f62e2-1620-4057-a22d-c93326d7155d-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:27 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 Nov 01 09:15:27 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:27 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" returned: 0 in 0.374s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:27 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b 1G Nov 01 09:15:27 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-93484f9f-227e-4890-a25b-154e771de42f-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Lock "cinder-93484f9f-227e-4890-a25b-154e771de42f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-93484f9f-227e-4890-a25b-154e771de42f" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-93484f9f-227e-4890-a25b-154e771de42f" acquired by "delete_volume" :: waited 0.029s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21ce5be-3b7f-407f-905f-5b0dc8819c5b]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:27 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f Nov 01 09:15:27 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:27 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b 1G" returned: 0 in 0.454s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:27 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:27 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b Nov 01 09:15:27 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:28 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f" returned: 0 in 0.389s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:28 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f Nov 01 09:15:28 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:28 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" returned: 0 in 0.310s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:28 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b is being set with open permissions: ugo+rw Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:28 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b Nov 01 09:15:28 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:28 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-93484f9f-227e-4890-a25b-154e771de42f" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-93484f9f-227e-4890-a25b-154e771de42f" released by "delete_volume" :: held 0.720s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Created reservations ['a0ef3d25-1540-4bc6-9458-627461cc876a', 'cce1915a-a243-47ab-8adc-1ce007d947aa', '108783dc-babe-4cfe-ab4d-3d7d9abdc598', '689be3e2-e102-4694-b21e-aa45ce443142'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:28 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" returned: 0 in 0.265s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:28 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.info Nov 01 09:15:28 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:28 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:28 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:28 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.info" returned: 0 in 0.306s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:28 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.info is being set with open permissions: ugo+rw Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:28 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.info Nov 01 09:15:28 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:28 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.303s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:28 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Deleted volume successfully. Nov 01 09:15:28 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-7dda70cf-b0a1-4443-a9ee-eb87da68c7cb tempest-ProjectReaderTests-656728974 None] Lock "cinder-93484f9f-227e-4890-a25b-154e771de42f-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:29 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.info" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:29 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-67fdbba8-a88d-467b-8e6f-ffc2e4ee9ea5 tempest-ProjectMemberTests-1799352219 None] Create snapshot completed successfully Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (6e052745-193d-444f-873e-2749fe7f2511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc851bd9-ec3b-4eda-9768-1cbc78b9fcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc851bd9-ec3b-4eda-9768-1cbc78b9fcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125948921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa3f6c2-0c93-4276-8360-b1fd96dde8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:29Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db5a5f9-7258-4196-98f2-bf9a3761b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db5a5f9-7258-4196-98f2-bf9a3761b722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104ee057-c498-469b-b2f8-97941e530b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104ee057-c498-469b-b2f8-97941e530b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa3f6c2-0c93-4276-8360-b1fd96dde8fb', 'volume_name': 'volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2a8336-4c63-4f6f-92a2-e00405e7fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2a8336-4c63-4f6f-92a2-e00405e7fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeaac41-4076-4be0-979d-6190619ddcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:29 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Volume 1fa3f6c2-0c93-4276-8360-b1fd96dde8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb', 'volume_size': 1} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125948921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa3f6c2-0c93-4276-8360-b1fd96dde8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d88ef86a235491388918ae5ce4ed9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:29Z,use_quota=True,user_id='02e27fdd1225474f880f6be66abec5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Creating volume 1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:29 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:29 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb 1073741824 Nov 01 09:15:29 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:29 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb 1073741824" returned: 0 in 0.420s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:29 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb Nov 01 09:15:29 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:30 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" returned: 0 in 0.245s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeaac41-4076-4be0-979d-6190619ddcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70bdefa-77ea-4df0-8511-581028bac77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:30 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Volume volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb (1fa3f6c2-0c93-4276-8360-b1fd96dde8fb): created successfully Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70bdefa-77ea-4df0-8511-581028bac77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Flow 'volume_create_manager' (6e052745-193d-444f-873e-2749fe7f2511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:30 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-02029c1d-d101-49b3-bb3c-70db4cdee855 tempest-ProjectReaderTests-656728974 None] Created volume successfully. Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-1f9405f0-4bb2-4ed9-a5d5-c22498e5608b-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Lock "cinder-1f9405f0-4bb2-4ed9-a5d5-c22498e5608b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Deleting offline snapshot 1f9405f0-4bb2-4ed9-a5d5-c22498e5608b of volume 91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] snapshot_file for this snap is: volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4322ac-8b22-4f6d-815f-d0925a3ae4a1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Creating offline snapshot 34d3d2cb-cd78-4509-b114-fc63f96aaa27 of volume 1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd57ca6d-b75f-481a-a37e-d73c427f4d4e]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:30 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b Nov 01 09:15:30 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:30 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb Nov 01 09:15:30 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:30 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" returned: 0 in 0.392s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb565761-6284-46fe-887f-e7bc43786491]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:30 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:31 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" returned: 0 in 0.413s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 1G {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:31 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 Nov 01 09:15:31 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:31 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 1G Nov 01 09:15:31 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:31 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" returned: 0 in 0.385s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:31 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b Nov 01 09:15:31 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:31 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 1G" returned: 0 in 0.415s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:31 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 Nov 01 09:15:31 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:31 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" returned: 0 in 0.364s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:31 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b Nov 01 09:15:31 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:31 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb -F qcow2 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27" returned: 0 in 0.335s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:31 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 is being set with open permissions: ugo+rw Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:31 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 Nov 01 09:15:31 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:31 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4.1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" returned: 0 in 0.252s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-1f9405f0-4bb2-4ed9-a5d5-c22498e5608b" released by "_delete_snapshot" :: held 1.501s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:31 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" released by "delete_snapshot" :: held 1.525s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Created reservations ['e40180a4-7a16-4221-b724-85fb85be2d14', 'd7ac0c0c-f069-47cc-b6de-8863369a9239', '8438c351-ecdc-4c7f-be35-88d62e507cbe', 'dedb368b-7900-4621-9b70-319e04b1a87c'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:32 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27" returned: 0 in 0.263s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:32 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.info Nov 01 09:15:32 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Delete snapshot completed successfully. Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-17a1b60d-3b38-4dc1-aba0-078a6e5a9a8c tempest-ProjectMemberTests-1799352219 None] Lock "cinder-1f9405f0-4bb2-4ed9-a5d5-c22498e5608b-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:32 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.info" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:32 devstack cinder-volume[86770]: WARNING cinder.volume.drivers.remotefs [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.info is being set with open permissions: ugo+rw Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.info {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:32 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.info Nov 01 09:15:32 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-91ffcf1d-7720-4e33-b99f-2d74a416dbc4-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:32 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.info" returned: 0 in 0.256s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-91ffcf1d-7720-4e33-b99f-2d74a416dbc4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:32 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-b3692159-7d9e-4fc3-bbdd-7a674161c8e0 tempest-ProjectReaderTests-656728974 None] Create snapshot completed successfully Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "cinder-quobyte-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7b5a54-4356-42bd-b05e-b67d1d226591]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:32 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:32 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 Nov 01 09:15:32 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:33 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" returned: 0 in 0.356s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:33 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4 Nov 01 09:15:33 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:33 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-quobyte-91ffcf1d-7720-4e33-b99f-2d74a416dbc4" released by "delete_volume" :: held 0.654s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Created reservations ['c3d52597-5bfc-4428-989d-e32ec66ab959', '647845c9-c262-4d08-ba4b-b898eb0b4db7', '8ce9a609-fa84-42d2-ac30-6e60d91ffaf6', '0924500b-6388-4f3b-a245-5f7d0ce3fb11'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:33 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:33 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:33 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.275s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:33 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Deleted volume successfully. Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-d3849ee5-7746-4fe7-b84f-b126d945ac61 tempest-ProjectMemberTests-1799352219 None] Lock "cinder-91ffcf1d-7720-4e33-b99f-2d74a416dbc4-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-34d3d2cb-cd78-4509-b114-fc63f96aaa27-delete_snapshot" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Lock "cinder-34d3d2cb-cd78-4509-b114-fc63f96aaa27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" by "delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-34d3d2cb-cd78-4509-b114-fc63f96aaa27" by "_delete_snapshot" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-34d3d2cb-cd78-4509-b114-fc63f96aaa27" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Deleting offline snapshot 34d3d2cb-cd78-4509-b114-fc63f96aaa27 of volume 1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] snapshot_file for this snap is: volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 {{(pid=86770) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8d0328-cc0a-4f66-9eb2-d561aa4c58ee]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:33 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:33 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 Nov 01 09:15:33 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:34 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:34 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86770) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:15:34 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d408392d-1f33-4c75-b89b-8d475adae156]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:34 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb Nov 01 09:15:34 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:34 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" returned: 0 in 0.385s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:34 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:34 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 Nov 01 09:15:34 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:35 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27" returned: 0 in 0.371s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:35 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27 Nov 01 09:15:35 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:35 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb.34d3d2cb-cd78-4509-b114-fc63f96aaa27" returned: 0 in 0.282s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-34d3d2cb-cd78-4509-b114-fc63f96aaa27" released by "_delete_snapshot" :: held 1.533s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" released by "delete_snapshot" :: held 1.556s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Created reservations ['7ffe7fca-b910-4cbf-b9b8-af0a833ce06d', '2d20018f-3473-410f-81b6-c28d73bbc0c4', 'f7680ed3-01cf-44b8-82da-0d6c4a227db0', '11ededb5-d104-427b-bc74-0c1b08ed39d5'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:35 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Delete snapshot completed successfully. Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-e9847f65-7cbd-40e7-a14b-61e5e0537198 tempest-ProjectReaderTests-656728974 None] Lock "cinder-34d3d2cb-cd78-4509-b114-fc63f96aaa27-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:35 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Lock "cinder-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Acquiring lock "cinder-quobyte-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75d8d80-ab06-4894-9b60-b8ea40817b94]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:36 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb Nov 01 09:15:36 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:36 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" returned: 0 in 0.391s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:36 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb Nov 01 09:15:36 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:36 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" returned: 0 in 0.274s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Lock "cinder-quobyte-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb" released by "delete_volume" :: held 0.740s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Created reservations ['2ddf6468-5f79-42cb-873a-fa36f6a73986', '2ebef77d-a101-4a83-b3c3-9e821f76cfc2', '80fe8d62-4434-4f21-bae1-7b1cfa462db6', '9f077169-9969-4e28-b988-9583eca52958'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:36 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:36 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:36 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:37 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.269s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:37 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Deleted volume successfully. Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-997eaebc-d30d-4163-be2d-a33611fd6b4a tempest-ProjectReaderTests-656728974 None] Lock "cinder-1fa3f6c2-0c93-4276-8360-b1fd96dde8fb-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Flow 'volume_create_manager' (55f2e139-00bf-4de3-b068-b4c540381ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec30b59b-35c4-4c2d-94f3-d4e8454f5395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec30b59b-35c4-4c2d-94f3-d4e8454f5395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088719273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f7ea11-8e71-439a-8045-c8b472069c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e16623be047441c8bf566ebe9ab447a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:38Z,use_quota=True,user_id='faf5ff97386b45fe8846ad811b33f7fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a4fdad-9cef-4e4e-9e56-1c6ef12c6e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a4fdad-9cef-4e4e-9e56-1c6ef12c6e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b3cc15-ea51-4af5-bcd1-080519000537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47b3cc15-ea51-4af5-bcd1-080519000537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f7ea11-8e71-439a-8045-c8b472069c01', 'volume_name': 'volume-88f7ea11-8e71-439a-8045-c8b472069c01', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4be686-1547-48a7-a591-63564e11de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4be686-1547-48a7-a591-63564e11de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b389eb4e-61e1-49d4-b199-e566207d0b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:37 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Volume 88f7ea11-8e71-439a-8045-c8b472069c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f7ea11-8e71-439a-8045-c8b472069c01', 'volume_size': 1} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088719273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f7ea11-8e71-439a-8045-c8b472069c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e16623be047441c8bf566ebe9ab447a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:38Z,use_quota=True,user_id='faf5ff97386b45fe8846ad811b33f7fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Creating volume 88f7ea11-8e71-439a-8045-c8b472069c01 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:37 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:37 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:37 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 1073741824 Nov 01 09:15:37 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:38 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 1073741824" returned: 0 in 0.484s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:38 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 Nov 01 09:15:38 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:38 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01" returned: 0 in 0.267s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b389eb4e-61e1-49d4-b199-e566207d0b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f7ea11-8e71-439a-8045-c8b472069c01', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea283af-6aa2-4780-b917-7eff206a38ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:38 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Volume volume-88f7ea11-8e71-439a-8045-c8b472069c01 (88f7ea11-8e71-439a-8045-c8b472069c01): created successfully Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea283af-6aa2-4780-b917-7eff206a38ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:38 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Flow 'volume_create_manager' (55f2e139-00bf-4de3-b068-b4c540381ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:38 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-268e2b2e-0610-4900-a644-a6dc9700f39e tempest-ProjectReaderTests-1301691130 None] Created volume successfully. Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Acquiring lock "cinder-88f7ea11-8e71-439a-8045-c8b472069c01-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-88f7ea11-8e71-439a-8045-c8b472069c01-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Acquiring lock "cinder-quobyte-88f7ea11-8e71-439a-8045-c8b472069c01" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-quobyte-88f7ea11-8e71-439a-8045-c8b472069c01" acquired by "delete_volume" :: waited 0.025s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b8faa-7905-4f7c-8164-a6b496bdf6a1]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:40 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 Nov 01 09:15:40 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:40 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01" returned: 0 in 0.378s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:40 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01 Nov 01 09:15:40 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:40 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-88f7ea11-8e71-439a-8045-c8b472069c01" returned: 0 in 0.254s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-quobyte-88f7ea11-8e71-439a-8045-c8b472069c01" released by "delete_volume" :: held 0.679s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Created reservations ['56c5d0f1-1609-4cf2-b8db-e68c281be024', 'debaadda-9bc9-4ce8-9502-46705e7119da', 'ef66a591-633e-4e46-9240-d6e64d207587', 'ba4562ba-5874-4d01-a7a9-84d2859948b8'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:40 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:40 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:40 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:41 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.241s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:41 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Deleted volume successfully. Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-11e275e2-e23d-4d22-969d-4072185872c8 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-88f7ea11-8e71-439a-8045-c8b472069c01-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Flow 'volume_create_manager' (c28280ef-5a48-4aba-bc64-43a860077a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1117aa75-7e4c-4c1e-b304-d79eb9f45665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1117aa75-7e4c-4c1e-b304-d79eb9f45665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122433818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7044c769-4d0d-46df-8df5-38dc78173c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e16623be047441c8bf566ebe9ab447a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:42Z,use_quota=True,user_id='faf5ff97386b45fe8846ad811b33f7fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90da97ee-dee5-41f9-ad5b-50f04866fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90da97ee-dee5-41f9-ad5b-50f04866fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eeb25b-412f-4eaa-a805-83fc6eb96f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eeb25b-412f-4eaa-a805-83fc6eb96f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7044c769-4d0d-46df-8df5-38dc78173c43', 'volume_name': 'volume-7044c769-4d0d-46df-8df5-38dc78173c43', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fc90a8-ccc7-4b29-b910-52b3c2144fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fc90a8-ccc7-4b29-b910-52b3c2144fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfb7d68-931c-4f90-a6d7-7b7c13f1cf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:41 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Volume 7044c769-4d0d-46df-8df5-38dc78173c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7044c769-4d0d-46df-8df5-38dc78173c43', 'volume_size': 1} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122433818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7044c769-4d0d-46df-8df5-38dc78173c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e16623be047441c8bf566ebe9ab447a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:42Z,use_quota=True,user_id='faf5ff97386b45fe8846ad811b33f7fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Creating volume 7044c769-4d0d-46df-8df5-38dc78173c43 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:41 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:41 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:41 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 1073741824 Nov 01 09:15:41 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:42 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 1073741824" returned: 0 in 0.445s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:42 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 Nov 01 09:15:42 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:42 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43" returned: 0 in 0.246s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfb7d68-931c-4f90-a6d7-7b7c13f1cf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7044c769-4d0d-46df-8df5-38dc78173c43', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4161e709-4110-4f0f-9cf4-14f9d2cd3a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:42 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Volume volume-7044c769-4d0d-46df-8df5-38dc78173c43 (7044c769-4d0d-46df-8df5-38dc78173c43): created successfully Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4161e709-4110-4f0f-9cf4-14f9d2cd3a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Flow 'volume_create_manager' (c28280ef-5a48-4aba-bc64-43a860077a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:42 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-bb5c9105-eeaa-4be1-a4e0-4c430b686fea tempest-ProjectReaderTests-1301691130 None] Created volume successfully. Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Acquiring lock "cinder-7044c769-4d0d-46df-8df5-38dc78173c43-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-7044c769-4d0d-46df-8df5-38dc78173c43-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Acquiring lock "cinder-quobyte-7044c769-4d0d-46df-8df5-38dc78173c43" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-quobyte-7044c769-4d0d-46df-8df5-38dc78173c43" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[92be660d-3855-4005-8157-b1e9d3c5a053]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:42 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:42 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 Nov 01 09:15:42 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:43 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43" returned: 0 in 0.348s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:43 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43 Nov 01 09:15:43 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:43 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7044c769-4d0d-46df-8df5-38dc78173c43" returned: 0 in 0.247s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-quobyte-7044c769-4d0d-46df-8df5-38dc78173c43" released by "delete_volume" :: held 0.641s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Created reservations ['d47390d7-9e53-40bd-ab88-d6defbbfdde9', '157d3ec9-ec35-47ea-9dcc-c979193aa45d', '6411941a-79cc-4e53-9229-94fea86263a2', '96506cb8-74ba-4e6a-866c-10ff965f7775'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:43 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:43 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:43 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.285s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:43 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Deleted volume successfully. Nov 01 09:15:43 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-62de3b86-c43f-4542-aa1d-b1a99bec4b85 tempest-ProjectReaderTests-1301691130 None] Lock "cinder-7044c769-4d0d-46df-8df5-38dc78173c43-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:53 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=61,cinder:INSERT=27,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:DELETE=8,cinder:SELECT=66,cinder:UPDATE=94,cinder:INSERT=20 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (45722c7c-0953-41df-9ca8-1338e55b2c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162d9d73-9bae-4201-85b1-c72bcd668e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162d9d73-9bae-4201-85b1-c72bcd668e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706390691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e855e1-5b5a-4c02-9f97-d71e620d098e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:57Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9471627-8d8d-4c68-a9db-509f4e535c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9471627-8d8d-4c68-a9db-509f4e535c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354e92cc-4eac-4070-8a89-8de99a270551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354e92cc-4eac-4070-8a89-8de99a270551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e855e1-5b5a-4c02-9f97-d71e620d098e', 'volume_name': 'volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057ed689-2773-4bda-8ac4-d762f8cc895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057ed689-2773-4bda-8ac4-d762f8cc895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510843d8-e3db-4de4-88b7-5a7c2ba64189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:56 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Volume d9e855e1-5b5a-4c02-9f97-d71e620d098e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e', 'volume_size': 1} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706390691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e855e1-5b5a-4c02-9f97-d71e620d098e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:57Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Creating volume d9e855e1-5b5a-4c02-9f97-d71e620d098e {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:56 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:56 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:56 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e 1073741824 Nov 01 09:15:56 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:57 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e 1073741824" returned: 0 in 0.396s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:57 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e Nov 01 09:15:57 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:57 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e" returned: 0 in 0.235s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510843d8-e3db-4de4-88b7-5a7c2ba64189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be7a627-0a4a-407b-9574-1b9f92347d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:57 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Volume volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e (d9e855e1-5b5a-4c02-9f97-d71e620d098e): created successfully Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be7a627-0a4a-407b-9574-1b9f92347d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (45722c7c-0953-41df-9ca8-1338e55b2c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:57 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-49476e61-0459-4809-a62d-280021314c67 tempest-ProjectReaderTests-324142480 None] Created volume successfully. Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-d9e855e1-5b5a-4c02-9f97-d71e620d098e-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Lock "cinder-d9e855e1-5b5a-4c02-9f97-d71e620d098e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-quobyte-d9e855e1-5b5a-4c02-9f97-d71e620d098e" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-d9e855e1-5b5a-4c02-9f97-d71e620d098e" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eae7ae0-6417-4c12-8b7d-bb6ce1e1b718]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:15:57 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:58 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e Nov 01 09:15:58 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:58 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e" returned: 0 in 0.341s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:58 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e Nov 01 09:15:58 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:58 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-d9e855e1-5b5a-4c02-9f97-d71e620d098e" returned: 0 in 0.231s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-d9e855e1-5b5a-4c02-9f97-d71e620d098e" released by "delete_volume" :: held 0.610s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Created reservations ['4d5afaf7-73f2-4dde-a1a0-12ff969dd997', '8ac4b0ac-8747-4101-a4a6-a082ddecf5c0', '4bf20f15-3713-457c-aaaf-9a8045206d48', '4199d9e5-a049-4572-84f0-0b6ff09b9c86'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:58 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:15:58 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:58 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:15:58 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Deleted volume successfully. Nov 01 09:15:58 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-332b4552-af2c-4a98-8c2e-949739587369 tempest-ProjectReaderTests-324142480 None] Lock "cinder-d9e855e1-5b5a-4c02-9f97-d71e620d098e-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (065dfa42-6399-46b4-b1b9-b1ea216b779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424a6d8b-b10b-499e-ba2a-07d38b92a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424a6d8b-b10b-499e-ba2a-07d38b92a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281980744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cff538-8901-4d02-9389-f842c7b608ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:59Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be98b3e-0c08-49cb-b403-4df2bb65d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be98b3e-0c08-49cb-b403-4df2bb65d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb12ccb5-249b-463a-8598-132a33a972c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb12ccb5-249b-463a-8598-132a33a972c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52cff538-8901-4d02-9389-f842c7b608ee', 'volume_name': 'volume-52cff538-8901-4d02-9389-f842c7b608ee', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962fc50b-7b7e-4f38-ad76-3be7f0a52345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962fc50b-7b7e-4f38-ad76-3be7f0a52345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670efbb6-aeed-450a-8f31-49ad29984a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:15:59 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Volume 52cff538-8901-4d02-9389-f842c7b608ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52cff538-8901-4d02-9389-f842c7b608ee', 'volume_size': 1} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281980744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cff538-8901-4d02-9389-f842c7b608ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:15:59Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Creating volume 52cff538-8901-4d02-9389-f842c7b608ee {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:15:59 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:59 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee 1073741824 Nov 01 09:15:59 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:15:59 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee 1073741824" returned: 0 in 0.391s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:15:59 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:15:59 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee Nov 01 09:15:59 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:00 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee" returned: 0 in 0.254s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670efbb6-aeed-450a-8f31-49ad29984a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cff538-8901-4d02-9389-f842c7b608ee', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13be96d-6d67-4c15-ab41-214186f9c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:00 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Volume volume-52cff538-8901-4d02-9389-f842c7b608ee (52cff538-8901-4d02-9389-f842c7b608ee): created successfully Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13be96d-6d67-4c15-ab41-214186f9c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (065dfa42-6399-46b4-b1b9-b1ea216b779b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:16:00 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-00e3af0e-44a2-4c2c-9f78-9a2f862e9022 tempest-ProjectReaderTests-324142480 None] Created volume successfully. Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-52cff538-8901-4d02-9389-f842c7b608ee-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Lock "cinder-52cff538-8901-4d02-9389-f842c7b608ee-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-quobyte-52cff538-8901-4d02-9389-f842c7b608ee" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-52cff538-8901-4d02-9389-f842c7b608ee" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e54575f-81d6-48c6-a1bd-ae016e1d7073]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:00 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee Nov 01 09:16:00 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:00 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee" returned: 0 in 0.345s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:00 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:00 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee Nov 01 09:16:00 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:01 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-52cff538-8901-4d02-9389-f842c7b608ee" returned: 0 in 0.234s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-52cff538-8901-4d02-9389-f842c7b608ee" released by "delete_volume" :: held 0.618s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Created reservations ['ece98585-2367-4280-9482-4d820d1ad16f', '05c4300b-c6e6-4f2a-9359-ffa6895568b8', 'd4ab7eff-29f1-4601-a38d-5344c99f6b1d', 'c8af5fed-5147-47e9-9077-ef5b67e5b033'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:01 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:16:01 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:01 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.244s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:16:01 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Deleted volume successfully. Nov 01 09:16:01 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-f1889dec-7300-429f-8f8f-8bf5b1e4ee18 tempest-ProjectReaderTests-324142480 None] Lock "cinder-52cff538-8901-4d02-9389-f842c7b608ee-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (303c16f9-b146-4f15-8d17-5f89ca349ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04f460a-8161-4b7f-a7a5-6991b7792c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04f460a-8161-4b7f-a7a5-6991b7792c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97061391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e4b04d-d7d5-4c2d-86dd-9be165b816f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:16:02Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7e4efe-aa7c-44f3-8d8f-d105c0b35986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7e4efe-aa7c-44f3-8d8f-d105c0b35986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166ea3b3-3182-41e5-8500-3aa51aeb910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166ea3b3-3182-41e5-8500-3aa51aeb910b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e4b04d-d7d5-4c2d-86dd-9be165b816f3', 'volume_name': 'volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211dac6f-3dca-4541-8a9e-6345485bd5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211dac6f-3dca-4541-8a9e-6345485bd5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72b78ba-c2aa-4ad4-9eda-815628f71390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:02 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Volume 27e4b04d-d7d5-4c2d-86dd-9be165b816f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3', 'volume_size': 1} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97061391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e4b04d-d7d5-4c2d-86dd-9be165b816f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:16:02Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Creating volume 27e4b04d-d7d5-4c2d-86dd-9be165b816f3 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:16:02 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:02 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 1073741824 Nov 01 09:16:02 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:02 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 1073741824" returned: 0 in 0.390s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:02 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 Nov 01 09:16:02 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:02 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3" returned: 0 in 0.235s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72b78ba-c2aa-4ad4-9eda-815628f71390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a9dbbc-60c8-4349-9375-c885bc64ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:02 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Volume volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 (27e4b04d-d7d5-4c2d-86dd-9be165b816f3): created successfully Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a9dbbc-60c8-4349-9375-c885bc64ed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:02 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (303c16f9-b146-4f15-8d17-5f89ca349ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:16:02 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-7992231a-6509-4aa5-b583-d90d01f14c45 tempest-ProjectReaderTests-324142480 None] Created volume successfully. Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-27e4b04d-d7d5-4c2d-86dd-9be165b816f3-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Lock "cinder-27e4b04d-d7d5-4c2d-86dd-9be165b816f3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-quobyte-27e4b04d-d7d5-4c2d-86dd-9be165b816f3" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-27e4b04d-d7d5-4c2d-86dd-9be165b816f3" acquired by "delete_volume" :: waited 0.013s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd535a4-08ed-4d86-8927-bd54d9b672df]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:03 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 Nov 01 09:16:03 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:03 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3" returned: 0 in 0.376s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:03 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3 Nov 01 09:16:03 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:03 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-27e4b04d-d7d5-4c2d-86dd-9be165b816f3" returned: 0 in 0.247s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-27e4b04d-d7d5-4c2d-86dd-9be165b816f3" released by "delete_volume" :: held 0.663s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Created reservations ['0dd6b82b-3730-46d3-b2c9-d4ca43fdffa4', '28ec2e53-a2a3-4e4f-b51e-f601d74948a7', '9a667daa-66d1-4be0-85db-cfb4b38b8d15', '3598db91-86c9-4829-9bb9-103c4d773fab'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:03 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:04 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:16:04 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:04 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.242s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:16:04 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Deleted volume successfully. Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-c9689083-4030-4797-80cb-abad445f61ac tempest-ProjectReaderTests-324142480 None] Lock "cinder-27e4b04d-d7d5-4c2d-86dd-9be165b816f3-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86770) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (5c270d35-8938-42d3-b81c-91d2820d4459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786787a1-9849-4f45-9ec1-7a24136f8740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786787a1-9849-4f45-9ec1-7a24136f8740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448894185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca06376-252e-4595-ad26-0430435cb3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:16:05Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e0ad5d-f9fb-4a0a-a797-108825318beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e0ad5d-f9fb-4a0a-a797-108825318beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ac2345-5fb5-4a53-b8c1-6a5a17ed871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ac2345-5fb5-4a53-b8c1-6a5a17ed871f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca06376-252e-4595-ad26-0430435cb3a4', 'volume_name': 'volume-7ca06376-252e-4595-ad26-0430435cb3a4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185d2447-6339-4c31-ab22-eb4d7056f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185d2447-6339-4c31-ab22-eb4d7056f383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91de777c-b6e7-48a7-95ab-8689f0b19ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:04 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Volume 7ca06376-252e-4595-ad26-0430435cb3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca06376-252e-4595-ad26-0430435cb3a4', 'volume_size': 1} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448894185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca06376-252e-4595-ad26-0430435cb3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='177405b15db9426a81830fa35daf311f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:16:05Z,use_quota=True,user_id='b33e5ee2764f4cb8a05f13df816d9174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5c4e187-798d-4ddd-92f9-1683808f9897),volume_type_id=e5c4e187-798d-4ddd-92f9-1683808f9897)}" {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.remotefs [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Creating volume 7ca06376-252e-4595-ad26-0430435cb3a4 {{(pid=86770) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Selected osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e as target Quobyte volume. {{(pid=86770) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:16:04 devstack cinder-volume[86770]: INFO cinder.volume.drivers.remotefs [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] casted to osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e Nov 01 09:16:04 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 1073741824 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:04 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 1073741824 Nov 01 09:16:04 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:05 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 1073741824" returned: 0 in 0.392s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:05 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 Nov 01 09:16:05 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:05 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4" returned: 0 in 0.232s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'} {{(pid=86770) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91de777c-b6e7-48a7-95ab-8689f0b19ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca06376-252e-4595-ad26-0430435cb3a4', 'volume_size': 1}' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a81968-36fb-41ce-ab27-a1505948474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:16:05 devstack cinder-volume[86770]: INFO cinder.volume.flows.manager.create_volume [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Volume volume-7ca06376-252e-4595-ad26-0430435cb3a4 (7ca06376-252e-4595-ad26-0430435cb3a4): created successfully Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a81968-36fb-41ce-ab27-a1505948474e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86770) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Flow 'volume_create_manager' (5c270d35-8938-42d3-b81c-91d2820d4459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86770) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:16:05 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-67e9eea1-8638-449d-92e1-8fcec087fbc6 tempest-ProjectReaderTests-324142480 None] Created volume successfully. Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-7ca06376-252e-4595-ad26-0430435cb3a4-delete_volume" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Lock "cinder-7ca06376-252e-4595-ad26-0430435cb3a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Acquiring lock "cinder-quobyte-7ca06376-252e-4595-ad26-0430435cb3a4" by "delete_volume" {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-7ca06376-252e-4595-ad26-0430435cb3a4" acquired by "delete_volume" :: waited 0.015s {{(pid=86770) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caa225c-0174-4bc5-8825-10fed3c4a041]: (4, 'qcow2') {{(pid=87706) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:16:05 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:05 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 Nov 01 09:16:05 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:06 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4" returned: 0 in 0.340s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:06 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4 Nov 01 09:16:06 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:06 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1/volume-7ca06376-252e-4595-ad26-0430435cb3a4" returned: 0 in 0.236s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Lock "cinder-quobyte-7ca06376-252e-4595-ad26-0430435cb3a4" released by "delete_volume" :: held 0.616s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG cinder.quota [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Created reservations ['cad935e0-d6b6-4182-ab3f-5ec49d1e9045', 'd785e438-2071-4ab0-b221-5e08ad5b38a6', '32bc3e89-721a-4b28-8019-6c3613779c85', '56b1b6c0-7ee9-4519-9e03-dc1e36fc2dee'] {{(pid=86770) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:06 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:16:06 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:06 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.234s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:16:06 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Deleted volume successfully. Nov 01 09:16:06 devstack cinder-volume[86770]: DEBUG cinder.coordination [None req-9ebdab52-fdfc-4ecf-af4f-b9f5ea4373b0 tempest-ProjectReaderTests-324142480 None] Lock "cinder-7ca06376-252e-4595-ad26-0430435cb3a4-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=86770) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:16:16 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:UPDATE=40,cinder:SELECT=32,cinder:DELETE=6,cinder:INSERT=10 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:16:16 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=48,cinder:DELETE=2 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e': None} {{(pid=86770) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG cinder.volume.drivers.quobyte [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-805988e8-e155-473b-8c9b-f8a2a6c0b29e'] {{(pid=86770) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86770) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:16:21 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1 Nov 01 09:16:21 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:16:21 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG oslo_concurrency.processutils [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/360d6a7454be90195cfd9d721176ffb1" returned: 0 in 0.240s {{(pid=86770) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG cinder.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Notifying Schedulers of capabilities ... {{(pid=86770) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG oslo_service.periodic_task [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] Running periodic task VolumeManager._thread_info {{(pid=86770) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread count: 29 {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:16:21 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-18c932c1-8058-48c7-a150-e8d97ecdea1d None None] thread info: [<_MainThread(MainThread, started 139379684118656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86770) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}